-- Logs begin at Mon 2022-10-24 13:00:24 UTC, end at Mon 2022-10-24 14:01:51 UTC. -- Oct 24 13:28:16.853176 dv-cinder-862490-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 24 13:28:16.865690 dv-cinder-862490-2-smb devstack@keystone.service[81751]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 13:28:16 2022] *** Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: nodename: dv-cinder-862490-2-smb Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: machine: x86_64 Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: clock source: unix Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: pcre jit disabled Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: detected number of CPU cores: 4 Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: current working directory: / Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: detected binary path: /usr/bin/uwsgi-core Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: your processes number limit is 47680 Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: your memory page size is 4096 bytes Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: detected max file descriptor number: 2048 Oct 24 13:28:16.867770 dv-cinder-862490-2-smb devstack@keystone.service[81751]: lock engine: pthread robust mutexes Oct 24 13:28:16.868727 dv-cinder-862490-2-smb devstack@keystone.service[81751]: thunder lock: enabled Oct 24 13:28:16.868727 dv-cinder-862490-2-smb devstack@keystone.service[81751]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 24 13:28:16.868727 dv-cinder-862490-2-smb devstack@keystone.service[81751]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 13:28:16.907262 dv-cinder-862490-2-smb devstack@keystone.service[81751]: Python main interpreter initialized at 0x558c15c8c9c0 Oct 24 13:28:16.907262 dv-cinder-862490-2-smb devstack@keystone.service[81751]: python threads support enabled Oct 24 13:28:16.907262 dv-cinder-862490-2-smb devstack@keystone.service[81751]: your server socket listen backlog is limited to 100 connections Oct 24 13:28:16.907262 dv-cinder-862490-2-smb devstack@keystone.service[81751]: your mercy for graceful operations on workers is 90 seconds Oct 24 13:28:16.907662 dv-cinder-862490-2-smb devstack@keystone.service[81751]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 13:28:16.907741 dv-cinder-862490-2-smb devstack@keystone.service[81751]: *** Operational MODE: preforking *** Oct 24 13:28:16.907987 dv-cinder-862490-2-smb devstack@keystone.service[81751]: *** uWSGI is running in multiple interpreter mode *** Oct 24 13:28:16.907987 dv-cinder-862490-2-smb devstack@keystone.service[81751]: spawned uWSGI master process (pid: 81751) Oct 24 13:28:16.908252 dv-cinder-862490-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 24 13:28:16.909882 dv-cinder-862490-2-smb devstack@keystone.service[81751]: spawned uWSGI worker 1 (pid: 81762, cores: 1) Oct 24 13:28:16.909882 dv-cinder-862490-2-smb devstack@keystone.service[81751]: spawned uWSGI worker 2 (pid: 81763, cores: 1) Oct 24 13:28:16.909882 dv-cinder-862490-2-smb devstack@keystone.service[81751]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 13:28:21.360570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:28:21.360570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: from cryptography.utils import int_from_bytes Oct 24 13:28:21.361404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:28:21.361404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: from cryptography.utils import int_from_bytes Oct 24 13:28:21.363915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:28:21.363915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: from cryptography.utils import int_from_bytes Oct 24 13:28:21.364401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:28:21.364401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: from cryptography.utils import int_from_bytes Oct 24 13:28:21.412223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:28:21.412442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:28:21.412598 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] command line args: [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:28:21.412862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:28:21.413000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ================================================================================ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:28:21.413282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] admin_token = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.413525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] config_dir = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.413716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.413846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] config_source = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.414057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] debug = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.414266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.414545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:28:21.414637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.414706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:28:21.414777 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.414895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] command line args: [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:28:21.415007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.415222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:28:21.415346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.415426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ================================================================================ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:28:21.415492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.415622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] admin_token = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.415698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_config_append = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.415800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.415870 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] config_dir = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.416017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_dir = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.416115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.416221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_file = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.416338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] config_source = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.416457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] debug = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.416566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.416690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.416801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.416968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417345 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.417969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_config_append = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.418026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.418148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.418230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.418303 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_dir = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.418417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.418485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_file = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.418649 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.418770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.418886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.419069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.419195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.419319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.419432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.419564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.419564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.419807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.419935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.419935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.420176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.420434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.420577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] publish_errors = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.420688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.420827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.420937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.421057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.421183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.421302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.421408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.421529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.421639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.421756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.421879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.422000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] standard_threads = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.422109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.422230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.422230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.422230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.422566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.422689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_journal = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.422846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] publish_errors = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.422998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_json = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.423118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.423255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_stderr = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.423255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_syslog = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.423474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.423474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.423745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.423865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.423973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.424084 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.424194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.424319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] standard_threads = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.424444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.424558 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.424674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.424796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.424906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.425036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.425147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.425260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_journal = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.425260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_json = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.425459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.425570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_stderr = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.425692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.425813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_syslog = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.425922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.426031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:28:21.426138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.426245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.426245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.426466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.426466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.426661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.426661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.426866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.426866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.427127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.427127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.427335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.427456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.427576 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.427698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.427809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.427927 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.428059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.428181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.428300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.428425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.428537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.428647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.428767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.428876 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.428988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.429210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.429324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.429432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.429553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.429663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.429773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.429900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.430011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.430119 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.430229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.430338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.430455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.430584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.430696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.430806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.431096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.431213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.431323 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.431452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.431564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.431792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.431909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.432077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.432259 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.432461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.432593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.432730 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.432864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.432992 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.433136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.433262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.433389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.433389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.433625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.433750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.433887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.434024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.434148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.434292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.434420 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.434546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.434685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.434821 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.434977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.435111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.435235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.435375 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.435608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.435750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.435878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.436007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.436134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.436258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.436396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.436524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.436658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.436794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.436918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.437051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.437195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.437320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.437452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.437575 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.437713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.437839 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.437979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.438107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.438238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.438364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.438494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.438621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.438764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.438890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.439082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.439208 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.439333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.439565 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.439745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.439914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.440093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.440256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.440433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.440612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.440765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.440894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.441023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.441150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.441277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.441404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.441544 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.441682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.441813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.441949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.442078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.442215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.442342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.442342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.442589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.442726 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.442868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.443034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.443175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.443302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.443447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.443574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.443702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.443894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.444021 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.444163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.444292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.444421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.444609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.444740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.444867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.445065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.445206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.445333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.445468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.445599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.445724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.445864 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.445991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.446125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.446251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.446374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.446502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.446645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.446781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.446908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.447060 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.447186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.447327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.447461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.447573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.447573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.447905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.448070 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.448244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.448422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.448422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.448658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.448783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.448783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.449072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.449316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.449316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.449569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.449700 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.449829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.449967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.449967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.450231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.450380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.450509 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.450635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.450761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.450888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.451060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.451209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.451338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.451467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.451593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.451720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.451848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.451848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.452104 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.452232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.452232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.452463 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.external = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.452591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.452729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.452857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.452984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.453112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.453250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.453398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.453525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.password = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.453652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.453825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.token = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.453972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.454099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.454238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.454366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.454507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.454637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.454768 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.454895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.455046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.455175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.455324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.455451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.455580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.external = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.455707 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.455835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.455963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.456104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.456235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.456367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.456495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.456624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.password = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.456753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.456894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.token = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.457032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.457162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.457289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.457426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.457564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.457706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.457851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.457980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.458115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.458244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.458374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.458516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.458645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.458774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.458916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.459084 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.459214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.459361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.459489 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.459619 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.459755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.459897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.460027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.460168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.460300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.460427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.460556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.460682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.460812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.460954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.461085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.461213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.461341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.461469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.461595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.461741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.461949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.462095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.462224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.462355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.462483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.462627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.462756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.462885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.463113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.463245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.463374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.463515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.463715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.463849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.463970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.464082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.464206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.464334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.464449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.464563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.464684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.464797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.465018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.465135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.465249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.465362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.465475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.465585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.465585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.465801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.465914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466264 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.466980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.467207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.467320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.467432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.467557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.467773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.467921 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.468057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.468188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.468316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.468443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.468575 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.468719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.468849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.468989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.469122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.469249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.469380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.469380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.469631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.469631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.469866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.469997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.470125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.470266 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.470395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.470522 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.470652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.470782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.470911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.471202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.471334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.471466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.471594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.471724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.471850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.471990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.472119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.472246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.472374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.472501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.472629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.472769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.472899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.473028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.473155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.473284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.473414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.473557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.473688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.473820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.473948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.474079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.474206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.474349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.474349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.474594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.474720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.474845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.474989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.475126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.475247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.475337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.475400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.475460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.475518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.475625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.475734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.475871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476847 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.476963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.477071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.477180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.477308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.477437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.477575 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.477689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.477802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.477924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.478036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.478158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.478281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.478391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.478500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.478687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.478789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.478946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.479068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.479195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.479321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.479434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.479559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.479669 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.479793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.479916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.479991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.480937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.481061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.481188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.481297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.481393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.481510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.481648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.481766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.481884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.481994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.482115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.482230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.482348 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.482455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.482561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.482665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.482764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.482868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483525 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483641 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.483929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.484063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.484141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.484141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.484299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.484404 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.484525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.484644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.484768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.484904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.485030 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.485153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.485278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.485400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.485524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.485664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.485789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.485912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.486040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.486165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.486289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.486433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.486557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.486650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.486756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.486885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.487094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] role.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.487333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.487456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] role.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.487579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.487696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.487814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.487936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.488067 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.488190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.488315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.488437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.488564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.488687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.488824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.488948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.489071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] role.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.489071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] role.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.489296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.489434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.489560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.489674 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.489778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.489907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490730 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.490911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.491994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492757 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.492929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493402 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.493960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494509 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.494884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495402 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.495971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.496941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497433 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.497937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.498859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:28:21.498974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.499156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.499389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.499634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.499857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.500095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.500327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:28:21.500494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:28:21.529447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.529670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.529742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.529804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.530026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.530162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.538993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.539164 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.568312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.568551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.568645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.568725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.623995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.624181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.674590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.674813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.675262 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.675508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.839216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.839478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.839478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.839777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.839911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.839998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.840082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.840158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.840246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.840376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.840506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.840633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.863879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.864108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.864329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.864414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.864547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.864630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.864760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.864845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.864970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.865056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.865182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.865282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.865443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.865650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.877080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.877244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.890344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.890534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.890630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.890697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.890790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.890943 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.891033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.891179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.891262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.891393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.891475 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.891605 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.891690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.891815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 13:28:21.909127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.909288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 13:28:21.909506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.909633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.909714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 13:28:21.909823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 13:28:21.910037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.910162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.910258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 13:28:21.910336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.910491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.910616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.910728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.910831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.911040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.911298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.920656 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.920836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.920920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.921117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.921248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.921392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.921479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.921665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.928436 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.928573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.931471 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.931632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.931805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.931944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.932085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.932238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.932363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.932609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.932697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.932889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.932976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.933152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.933238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.933421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.933517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.933690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.933778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.933960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.934047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.934227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.934316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.934496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.956875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.957378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.958342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.958628 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.958857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.959167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.963323 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.963608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.964046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.964136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.964339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.964622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.970638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.970948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.971110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.971367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.976887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.977193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.977318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.977458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.977677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.977814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.977966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.978110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.978242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.978362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.978597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.978759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.978879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.979052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.979177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.979425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.994478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.994761 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.995118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.995411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:21.998626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:21.999299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.001817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.002114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.002492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.002796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.006243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.007010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.009403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.010445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.012728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.013082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.013428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.013645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.013757 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.013950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.014150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.014263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.014520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.014618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.014799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.015103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.030872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.031196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.031347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.031435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.031664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.031791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.031918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.033644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.038474 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.039095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.040031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.040618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.041661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.042023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.042483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.042772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.044674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.044953 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.045234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.045482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.045608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.045777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.045904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.046033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.046345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.046716 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.057055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.057341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.057692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.057970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.058134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.058361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.058488 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.058655 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.058782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.058902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.059018 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.059383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.059664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.059930 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.074443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.075464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.077322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.078351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.080262 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.081357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.081679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.082782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.083169 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.083450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.083843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.084362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.084650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.085058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.090174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.091595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.091694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.093071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.094493 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.094892 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.095201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.095475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.095949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.096350 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.096638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.096920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.103182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.103498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.103779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.104894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.105191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.105473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.110600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.110883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.111185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.111459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.111725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.111990 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.112257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.112339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 13:28:22.112539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.112621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.112864 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.112946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.113142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.113233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.113417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.113502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.113691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.113773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.113964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.114054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.114251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.114333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.114520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.114787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.115091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.115356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.115648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.115916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 13:28:22.148266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c15c8c9c0 pid: 81763 (default app) Oct 24 13:28:22.151336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c15c8c9c0 pid: 81762 (default app) Oct 24 13:28:22.151960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3dde2-333a-4414-b6fa-ba2fc4f88c13 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:22.152243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3dde2-333a-4414-b6fa-ba2fc4f88c13 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:22.152512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3dde2-333a-4414-b6fa-ba2fc4f88c13 None None] PATH_INFO: `/v3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:22.157121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Mon Oct 24 13:28:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:29.099982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17197ba-33d4-4796-9f55-98311130eed7 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:29.100778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17197ba-33d4-4796-9f55-98311130eed7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:29.100778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17197ba-33d4-4796-9f55-98311130eed7 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:29.105612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:29.111586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:29.112233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:29.112233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:29.183395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: INFO dbcounter [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] Registered counter for database keystone Oct 24 13:28:29.204132 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG oslo_db.sqlalchemy.engines [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:28:29.211176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writer thread running {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:28:29.398549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG passlib.handlers.bcrypt [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81763) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 13:28:29.398969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG passlib.handlers.bcrypt [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81763) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 13:28:29.459259 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:29.460871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:29.600833 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:28:30.062525 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17197ba-33d4-4796-9f55-98311130eed7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:30.134207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: INFO dbcounter [None req-a17197ba-33d4-4796-9f55-98311130eed7 None None] Registered counter for database keystone Oct 24 13:28:30.158014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG oslo_db.sqlalchemy.engines [None req-a17197ba-33d4-4796-9f55-98311130eed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:28:30.165907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writer thread running {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:28:30.285467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17197ba-33d4-4796-9f55-98311130eed7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:30.292049 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3936-75be-407e-885a-35938a1717f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:30.292696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3936-75be-407e-885a-35938a1717f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:30.292969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3936-75be-407e-885a-35938a1717f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:30.293236 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3936-75be-407e-885a-35938a1717f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:30.302393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3936-75be-407e-885a-35938a1717f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:30.354742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7fab3936-75be-407e-885a-35938a1717f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 13:28:30.355055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3936-75be-407e-885a-35938a1717f6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:30.365624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Mon Oct 24 13:28:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:28:30.372594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:30.391151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f683e-44a0-4925-b53f-77de538f8d0c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:30.396005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491aaf4-20a1-44d6-a145-ff06e74440bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:30.397152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491aaf4-20a1-44d6-a145-ff06e74440bb admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:30.397512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491aaf4-20a1-44d6-a145-ff06e74440bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:30.397665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491aaf4-20a1-44d6-a145-ff06e74440bb admin admin] PATH_INFO: `/v3/projects/2412fb672dec485f9e4dda53e202b718` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:30.399359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491aaf4-20a1-44d6-a145-ff06e74440bb admin admin] RBAC: Authorizing `identity:get_project(project_id=2412fb672dec485f9e4dda53e202b718)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:30.453688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2491aaf4-20a1-44d6-a145-ff06e74440bb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 13:28:30.454004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491aaf4-20a1-44d6-a145-ff06e74440bb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:30.458690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Mon Oct 24 13:28:30 2022] GET /identity/v3/projects/2412fb672dec485f9e4dda53e202b718 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:32.689554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855983f-dc9d-4ef6-8562-b9b8c348e707 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:32.690129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855983f-dc9d-4ef6-8562-b9b8c348e707 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:32.690129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855983f-dc9d-4ef6-8562-b9b8c348e707 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:32.694140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:32.700785 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ce589-3664-463d-8bfb-39fdbb6f6cf6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:32.701287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ce589-3664-463d-8bfb-39fdbb6f6cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:32.701287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ce589-3664-463d-8bfb-39fdbb6f6cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:32.722613 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5e4ce589-3664-463d-8bfb-39fdbb6f6cf6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:32.724209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5e4ce589-3664-463d-8bfb-39fdbb6f6cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:32.734300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:28:33.002159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855983f-dc9d-4ef6-8562-b9b8c348e707 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:33.015188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855983f-dc9d-4ef6-8562-b9b8c348e707 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:33.020106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792411-28ba-4ca2-a71e-de422ff898a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:33.020728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792411-28ba-4ca2-a71e-de422ff898a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:33.021100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792411-28ba-4ca2-a71e-de422ff898a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:33.021375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792411-28ba-4ca2-a71e-de422ff898a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:33.030742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f792411-28ba-4ca2-a71e-de422ff898a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:33.032580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f792411-28ba-4ca2-a71e-de422ff898a2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:33.042574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Mon Oct 24 13:28:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:28:33.048610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ce589-3664-463d-8bfb-39fdbb6f6cf6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:33.058887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ce589-3664-463d-8bfb-39fdbb6f6cf6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:33.063494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6498-03d2-4e85-b6ab-b493c6b458b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:33.064140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6498-03d2-4e85-b6ab-b493c6b458b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:33.064417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6498-03d2-4e85-b6ab-b493c6b458b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:33.064691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6498-03d2-4e85-b6ab-b493c6b458b4 admin admin] PATH_INFO: `/v3/users/5707d799f4af482d868dd62b5ec82b2f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:33.066029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6498-03d2-4e85-b6ab-b493c6b458b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=5707d799f4af482d868dd62b5ec82b2f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:33.067932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6498-03d2-4e85-b6ab-b493c6b458b4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:33.069517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Mon Oct 24 13:28:33 2022] GET /identity/v3/users/5707d799f4af482d868dd62b5ec82b2f => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:35.312983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e092f4-97c5-48d8-8025-4b03e868823c None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:35.313599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e092f4-97c5-48d8-8025-4b03e868823c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:35.313913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e092f4-97c5-48d8-8025-4b03e868823c None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:35.316434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:35.323032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685af596-54e0-4e57-b7aa-acc3a958e432 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:35.323553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685af596-54e0-4e57-b7aa-acc3a958e432 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:35.323553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685af596-54e0-4e57-b7aa-acc3a958e432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:35.343077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-685af596-54e0-4e57-b7aa-acc3a958e432 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:35.344270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-685af596-54e0-4e57-b7aa-acc3a958e432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:35.409071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8df34a-5618-4db9-ad3f-15efa1dfbe83 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:35.409352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8df34a-5618-4db9-ad3f-15efa1dfbe83 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:35.409630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8df34a-5618-4db9-ad3f-15efa1dfbe83 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:35.411031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:28:35.416839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723152ef-ef61-44fc-a91f-c04f56e4a270 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:35.417123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723152ef-ef61-44fc-a91f-c04f56e4a270 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:35.417398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723152ef-ef61-44fc-a91f-c04f56e4a270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:35.457023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:35.460998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG passlib.handlers.bcrypt [None req-723152ef-ef61-44fc-a91f-c04f56e4a270 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81762) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 13:28:35.461390 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG passlib.handlers.bcrypt [None req-723152ef-ef61-44fc-a91f-c04f56e4a270 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81762) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 13:28:35.510616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-723152ef-ef61-44fc-a91f-c04f56e4a270 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:35.512279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-723152ef-ef61-44fc-a91f-c04f56e4a270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:35.622423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:28:35.734181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685af596-54e0-4e57-b7aa-acc3a958e432 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:35.760521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:35.848739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685af596-54e0-4e57-b7aa-acc3a958e432 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:35.888852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cfcc1-3765-4dbc-9fdc-35ae28c5764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:35.889663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cfcc1-3765-4dbc-9fdc-35ae28c5764d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:35.889663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cfcc1-3765-4dbc-9fdc-35ae28c5764d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:35.889927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cfcc1-3765-4dbc-9fdc-35ae28c5764d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:35.890762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723152ef-ef61-44fc-a91f-c04f56e4a270 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:35.904176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cfcc1-3765-4dbc-9fdc-35ae28c5764d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-810cfcc1-3765-4dbc-9fdc-35ae28c5764d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:35.913579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:35.914495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:28:35.915539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:28:35.920813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cfcc1-3765-4dbc-9fdc-35ae28c5764d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:36.011366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723152ef-ef61-44fc-a91f-c04f56e4a270 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:36.013912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:36.014905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:36.038707 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cfcc1-3765-4dbc-9fdc-35ae28c5764d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:36.051483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:36.052373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:36.052644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:36.052913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:36.053874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:36.055380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:36.075409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.sql.core [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:28:36.075409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:28:36.075409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [parameters: {'id': 'ba0282038c0244fdbe5e934bfeb78a74', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 13:28:36.075409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81762) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:28:36.085632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f830fe-dc8c-48f5-b02f-17bccda299dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:36.086255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f830fe-dc8c-48f5-b02f-17bccda299dc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:36.086526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f830fe-dc8c-48f5-b02f-17bccda299dc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:36.086797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f830fe-dc8c-48f5-b02f-17bccda299dc None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:36.087691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f830fe-dc8c-48f5-b02f-17bccda299dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:36.087691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f830fe-dc8c-48f5-b02f-17bccda299dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:36.089279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f830fe-dc8c-48f5-b02f-17bccda299dc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:28:36.094255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result.read() Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 13:28:36.095218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application yield resource Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise self.value Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application session.commit() Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:28:36.096289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:28:36.097311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:28:36.098159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result.read() Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:28:36.098981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [parameters: {'id': 'ba0282038c0244fdbe5e934bfeb78a74', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 13:28:36.101439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:36.102699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 8/15] 10.222.0.46 () {60 vars in 1137 bytes} [Mon Oct 24 13:28:35 2022] POST /identity/v3/domains => generated 190 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:28:36.105068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:36.107192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 8/16] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:28:36.109432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f830fe-dc8c-48f5-b02f-17bccda299dc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:36.224915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624790f-8dbc-4fc4-909b-6fc4343eb3d3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:36.229329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f830fe-dc8c-48f5-b02f-17bccda299dc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:36.266749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143a532-fa8e-407b-ae74-c10cc602b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:36.267419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143a532-fa8e-407b-ae74-c10cc602b681 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:36.267692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143a532-fa8e-407b-ae74-c10cc602b681 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:36.267958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143a532-fa8e-407b-ae74-c10cc602b681 None admin] PATH_INFO: `/v3/users/5707d799f4af482d868dd62b5ec82b2f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:36.269252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143a532-fa8e-407b-ae74-c10cc602b681 None admin] RBAC: Authorizing `identity:get_user(user_id=5707d799f4af482d868dd62b5ec82b2f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:36.270737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143a532-fa8e-407b-ae74-c10cc602b681 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:36.272368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:28:36 2022] GET /identity/v3/users/5707d799f4af482d868dd62b5ec82b2f => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:28:36.273900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7eea-841d-4558-9eda-355105e1784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:36.274883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7eea-841d-4558-9eda-355105e1784f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:36.275363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7eea-841d-4558-9eda-355105e1784f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:36.275776 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7eea-841d-4558-9eda-355105e1784f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:36.278101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143a532-fa8e-407b-ae74-c10cc602b681 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:36.295528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:36.295771 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d7eea-841d-4558-9eda-355105e1784f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:36.297280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d7eea-841d-4558-9eda-355105e1784f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-4a2d7eea-841d-4558-9eda-355105e1784f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:28:36.314434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:36.315996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:28:36.316783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:28:36.316783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:28:36.316783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:36.316783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:28:36.321682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7eea-841d-4558-9eda-355105e1784f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:36.345248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:36.416305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143a532-fa8e-407b-ae74-c10cc602b681 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:36.451022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7eea-841d-4558-9eda-355105e1784f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:36.461807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcca80f-7d40-408d-b4ec-2a0a01a9de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:36.462510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca80f-7d40-408d-b4ec-2a0a01a9de60 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:36.462782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca80f-7d40-408d-b4ec-2a0a01a9de60 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:36.463086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca80f-7d40-408d-b4ec-2a0a01a9de60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:36.464382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcca80f-7d40-408d-b4ec-2a0a01a9de60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:36.465855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcca80f-7d40-408d-b4ec-2a0a01a9de60 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:36.467667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:28:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:28:36.474288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcca80f-7d40-408d-b4ec-2a0a01a9de60 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:36.490573 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b694d-9192-4a70-9ef2-f7395d0b0645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:36.491212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b694d-9192-4a70-9ef2-f7395d0b0645 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:36.491546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b694d-9192-4a70-9ef2-f7395d0b0645 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:36.491820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b694d-9192-4a70-9ef2-f7395d0b0645 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:36.492475 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b694d-9192-4a70-9ef2-f7395d0b0645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:36.492937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b694d-9192-4a70-9ef2-f7395d0b0645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:36.494231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b694d-9192-4a70-9ef2-f7395d0b0645 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:36.513319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:28:36.596743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:36.620287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcca80f-7d40-408d-b4ec-2a0a01a9de60 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:36.661138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c0dff-36df-446b-a533-8f9fbbc1906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:36.662127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c0dff-36df-446b-a533-8f9fbbc1906d None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:36.662574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c0dff-36df-446b-a533-8f9fbbc1906d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:36.663027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c0dff-36df-446b-a533-8f9fbbc1906d None admin] PATH_INFO: `/v3/domains/default/users/5707d799f4af482d868dd62b5ec82b2f/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:36.665682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c0dff-36df-446b-a533-8f9fbbc1906d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5707d799f4af482d868dd62b5ec82b2f, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:36.666837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c0dff-36df-446b-a533-8f9fbbc1906d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:36.785118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 11/21] 10.222.0.46 () {58 vars in 1361 bytes} [Mon Oct 24 13:28:36 2022] PUT /identity/v3/domains/default/users/5707d799f4af482d868dd62b5ec82b2f/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:28:39.167534 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd961dd-6b5c-46ab-a0a0-12013c1a8353 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:39.168091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd961dd-6b5c-46ab-a0a0-12013c1a8353 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:39.168424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd961dd-6b5c-46ab-a0a0-12013c1a8353 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:39.170419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:39.177796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a231-a893-431c-9080-b1daced00120 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:39.178282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a231-a893-431c-9080-b1daced00120 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:39.178668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a231-a893-431c-9080-b1daced00120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:39.215390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9ca8a231-a893-431c-9080-b1daced00120 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:39.217016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9ca8a231-a893-431c-9080-b1daced00120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:39.324753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:39.592717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3728-480d-47e1-a4b0-3b8255620c10 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:39.593421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3728-480d-47e1-a4b0-3b8255620c10 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:39.593908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3728-480d-47e1-a4b0-3b8255620c10 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:39.595478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:28:39.601529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929996ad-bf97-4626-814b-eb3ef4d8d76d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:39.602254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929996ad-bf97-4626-814b-eb3ef4d8d76d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:39.602767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929996ad-bf97-4626-814b-eb3ef4d8d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:39.632118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-929996ad-bf97-4626-814b-eb3ef4d8d76d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:39.634283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-929996ad-bf97-4626-814b-eb3ef4d8d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:39.723504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:39.731426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:39.840708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0446cb-1524-451e-a3ff-b44608c870bc None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:39.841598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0446cb-1524-451e-a3ff-b44608c870bc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:39.842316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0446cb-1524-451e-a3ff-b44608c870bc None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:39.844085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 13/26] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:28:39.849947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f14d5-a7b1-4aa2-9ae3-6f19a5dd1bb8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:39.850513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f14d5-a7b1-4aa2-9ae3-6f19a5dd1bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:39.851026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f14d5-a7b1-4aa2-9ae3-6f19a5dd1bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:39.872605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0446cb-1524-451e-a3ff-b44608c870bc None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:39.893780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e19f14d5-a7b1-4aa2-9ae3-6f19a5dd1bb8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:39.895029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e19f14d5-a7b1-4aa2-9ae3-6f19a5dd1bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:40.058958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:40.096777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0446cb-1524-451e-a3ff-b44608c870bc None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:40.097088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 14/27] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:40.142648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131f315-7c9d-4812-810c-3d0f7bd7232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:40.143342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131f315-7c9d-4812-810c-3d0f7bd7232c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:40.143616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131f315-7c9d-4812-810c-3d0f7bd7232c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:40.143885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131f315-7c9d-4812-810c-3d0f7bd7232c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:40.156545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131f315-7c9d-4812-810c-3d0f7bd7232c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:40.164302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131f315-7c9d-4812-810c-3d0f7bd7232c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-5131f315-7c9d-4812-810c-3d0f7bd7232c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:28:40.184299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:40.185644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:28:40.187003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:28:40.187003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:28:40.187003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:40.187003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 14/28] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:28:40.191686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f14d5-a7b1-4aa2-9ae3-6f19a5dd1bb8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:40.216435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df2b92-18f0-403a-ba8b-064b5f86cbb0 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:40.216754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df2b92-18f0-403a-ba8b-064b5f86cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:40.217127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df2b92-18f0-403a-ba8b-064b5f86cbb0 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:40.218564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 15/29] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:28:40.228218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4c45-e64c-44f3-ad73-249bdd61800d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:40.228531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4c45-e64c-44f3-ad73-249bdd61800d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:40.228773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4c45-e64c-44f3-ad73-249bdd61800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:40.266567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-661c4c45-e64c-44f3-ad73-249bdd61800d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:40.268355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-661c4c45-e64c-44f3-ad73-249bdd61800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:40.412452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 16/30] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:28:40.413803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4c45-e64c-44f3-ad73-249bdd61800d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:40.445381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f14d5-a7b1-4aa2-9ae3-6f19a5dd1bb8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:40.514065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:40.533874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af802a0d-f1fd-44c0-b6bd-011131e50731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:40.534513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af802a0d-f1fd-44c0-b6bd-011131e50731 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:40.534792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af802a0d-f1fd-44c0-b6bd-011131e50731 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:40.535086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af802a0d-f1fd-44c0-b6bd-011131e50731 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:40.535750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af802a0d-f1fd-44c0-b6bd-011131e50731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:40.536050 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af802a0d-f1fd-44c0-b6bd-011131e50731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:40.537687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af802a0d-f1fd-44c0-b6bd-011131e50731 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:40.566102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:40.584397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 15/31] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:28:40.599757 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af802a0d-f1fd-44c0-b6bd-011131e50731 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:40.677422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4c45-e64c-44f3-ad73-249bdd61800d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:40.741130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea9f33-7425-4a33-8868-93991826e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:40.741781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea9f33-7425-4a33-8868-93991826e15e None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:40.742149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea9f33-7425-4a33-8868-93991826e15e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:40.742517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea9f33-7425-4a33-8868-93991826e15e None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:40.743429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea9f33-7425-4a33-8868-93991826e15e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:40.745549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea9f33-7425-4a33-8868-93991826e15e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:40.793409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af802a0d-f1fd-44c0-b6bd-011131e50731 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:40.859937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5800b-e94b-41ad-92b3-20571756b90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:40.860583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5800b-e94b-41ad-92b3-20571756b90c None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:40.861068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5800b-e94b-41ad-92b3-20571756b90c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:40.861346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5800b-e94b-41ad-92b3-20571756b90c None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:40.862063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5800b-e94b-41ad-92b3-20571756b90c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:40.863616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5800b-e94b-41ad-92b3-20571756b90c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:40.928409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 17/32] 10.222.0.46 () {60 vars in 1131 bytes} [Mon Oct 24 13:28:40 2022] POST /identity/v3/roles => generated 225 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:28:40.929409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea9f33-7425-4a33-8868-93991826e15e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:40.929847 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 16/33] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:28:40 2022] POST /identity/v3/projects => generated 301 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:28:40.939527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5800b-e94b-41ad-92b3-20571756b90c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:41.046319 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:41.175894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5800b-e94b-41ad-92b3-20571756b90c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:41.245855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0545-6be2-4035-8e23-6aa1dde1b60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:41.246476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0545-6be2-4035-8e23-6aa1dde1b60c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:41.246733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0545-6be2-4035-8e23-6aa1dde1b60c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:41.247033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0545-6be2-4035-8e23-6aa1dde1b60c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:41.267326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0545-6be2-4035-8e23-6aa1dde1b60c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:41.268167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea9f33-7425-4a33-8868-93991826e15e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-21ac0545-6be2-4035-8e23-6aa1dde1b60c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:41.273639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:41.275165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:28:41.275913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 17/34] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:28:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:28:41.277737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b902f-c82e-4795-87a7-ff60a3f7b066 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:41.277865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b902f-c82e-4795-87a7-ff60a3f7b066 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:41.278090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b902f-c82e-4795-87a7-ff60a3f7b066 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:41.283059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 18/35] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:41.285204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b902f-c82e-4795-87a7-ff60a3f7b066 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:41.309618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:41.331436 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12748a5-bda6-4ec7-a81e-1dbc8f4893e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:41.332053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12748a5-bda6-4ec7-a81e-1dbc8f4893e5 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:41.332336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12748a5-bda6-4ec7-a81e-1dbc8f4893e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:41.332624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12748a5-bda6-4ec7-a81e-1dbc8f4893e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:41.333310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12748a5-bda6-4ec7-a81e-1dbc8f4893e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:41.334855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12748a5-bda6-4ec7-a81e-1dbc8f4893e5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:41.364249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 18/36] 10.222.0.46 () {60 vars in 1131 bytes} [Mon Oct 24 13:28:40 2022] POST /identity/v3/roles => generated 219 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:28:41.367951 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff910b-fd11-4002-880b-58f842eaef57 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:41.368267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff910b-fd11-4002-880b-58f842eaef57 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:41.368574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff910b-fd11-4002-880b-58f842eaef57 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:41.370669 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 19/37] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:41.371729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc97498-d3ce-478d-9ef3-b9076f773528 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:41.372028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc97498-d3ce-478d-9ef3-b9076f773528 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:41.372277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc97498-d3ce-478d-9ef3-b9076f773528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:41.404518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7fc97498-d3ce-478d-9ef3-b9076f773528 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:41.404518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7fc97498-d3ce-478d-9ef3-b9076f773528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:41.474035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b902f-c82e-4795-87a7-ff60a3f7b066 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:41.476821 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:41.518349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 20/38] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:41.518796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7409e-180c-4b86-ae0b-6f27c869ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:41.519607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7409e-180c-4b86-ae0b-6f27c869ca63 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:41.520027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7409e-180c-4b86-ae0b-6f27c869ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:41.520421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7409e-180c-4b86-ae0b-6f27c869ca63 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:41.520514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c9155-de6d-4484-8a27-e8df39b92b09 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:41.521019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c9155-de6d-4484-8a27-e8df39b92b09 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:41.521439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c9155-de6d-4484-8a27-e8df39b92b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:41.521577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7409e-180c-4b86-ae0b-6f27c869ca63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:41.521989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7409e-180c-4b86-ae0b-6f27c869ca63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:41.523637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7409e-180c-4b86-ae0b-6f27c869ca63 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:41.535193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 19/39] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:41.546952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7409e-180c-4b86-ae0b-6f27c869ca63 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:41.549330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5e2c9155-de6d-4484-8a27-e8df39b92b09 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:41.551720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5e2c9155-de6d-4484-8a27-e8df39b92b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:41.663552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 21/40] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:41.803413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7409e-180c-4b86-ae0b-6f27c869ca63 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:41.841932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dca39-d7da-404b-a4f9-4ea2a61fa41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:41.842582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dca39-d7da-404b-a4f9-4ea2a61fa41d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:41.842865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dca39-d7da-404b-a4f9-4ea2a61fa41d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:41.843167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dca39-d7da-404b-a4f9-4ea2a61fa41d None admin] PATH_INFO: `/v3/users/5707d799f4af482d868dd62b5ec82b2f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:41.844306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dca39-d7da-404b-a4f9-4ea2a61fa41d None admin] RBAC: Authorizing `identity:get_user(user_id=5707d799f4af482d868dd62b5ec82b2f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:41.845787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dca39-d7da-404b-a4f9-4ea2a61fa41d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:41.847597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 20/41] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:28:41 2022] GET /identity/v3/users/5707d799f4af482d868dd62b5ec82b2f => generated 247 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:28:41.854293 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dca39-d7da-404b-a4f9-4ea2a61fa41d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:41.854514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c9155-de6d-4484-8a27-e8df39b92b09 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:41.894262 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:41.909996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:41.978414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dca39-d7da-404b-a4f9-4ea2a61fa41d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:41.978880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c9155-de6d-4484-8a27-e8df39b92b09 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:42.017818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f23c4-ffa0-4247-bcd2-33ce33553384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:42.018436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f23c4-ffa0-4247-bcd2-33ce33553384 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:42.018719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f23c4-ffa0-4247-bcd2-33ce33553384 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:42.019003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f23c4-ffa0-4247-bcd2-33ce33553384 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:42.019677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f23c4-ffa0-4247-bcd2-33ce33553384 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:42.021099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f23c4-ffa0-4247-bcd2-33ce33553384 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:42.022598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caa36f-cddf-4751-bb1b-5774a7b5ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:42.023270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caa36f-cddf-4751-bb1b-5774a7b5ff6a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:42.023544 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caa36f-cddf-4751-bb1b-5774a7b5ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:42.023816 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caa36f-cddf-4751-bb1b-5774a7b5ff6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:42.025191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17caa36f-cddf-4751-bb1b-5774a7b5ff6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:42.026855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17caa36f-cddf-4751-bb1b-5774a7b5ff6a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:42.028537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 22/42] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:28:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:42.029489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caa36f-cddf-4751-bb1b-5774a7b5ff6a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:42.039895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 21/43] 10.222.0.46 () {60 vars in 1131 bytes} [Mon Oct 24 13:28:41 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:28:42.040810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f23c4-ffa0-4247-bcd2-33ce33553384 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:42.176523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caa36f-cddf-4751-bb1b-5774a7b5ff6a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:42.188622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:42.191631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:42.206637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f23c4-ffa0-4247-bcd2-33ce33553384 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:42.220956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d3118-31c6-4cc6-92fc-71d1d304300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:42.222220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3118-31c6-4cc6-92fc-71d1d304300f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:42.222667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3118-31c6-4cc6-92fc-71d1d304300f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:42.222935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3118-31c6-4cc6-92fc-71d1d304300f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:42.224440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d3118-31c6-4cc6-92fc-71d1d304300f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:42.226329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d3118-31c6-4cc6-92fc-71d1d304300f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:42.228589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 23/44] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:28:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:42.234471 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d3118-31c6-4cc6-92fc-71d1d304300f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:42.248728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589703ef-b309-4f4f-8832-bfdeb1ef04f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:42.249364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589703ef-b309-4f4f-8832-bfdeb1ef04f9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:42.249636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589703ef-b309-4f4f-8832-bfdeb1ef04f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:42.249915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589703ef-b309-4f4f-8832-bfdeb1ef04f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:42.250656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589703ef-b309-4f4f-8832-bfdeb1ef04f9 None admin] RBAC: Adding query filter params (role.id=581091dd624142d3aad6710d1eb0affa, scope.domain.id=default, user.id=5707d799f4af482d868dd62b5ec82b2f) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:42.250996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589703ef-b309-4f4f-8832-bfdeb1ef04f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:42.253695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589703ef-b309-4f4f-8832-bfdeb1ef04f9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:42.261815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 22/45] 10.222.0.46 () {56 vars in 1322 bytes} [Mon Oct 24 13:28:42 2022] GET /identity/v3/role_assignments?user.id=5707d799f4af482d868dd62b5ec82b2f&scope.domain.id=default&role.id=581091dd624142d3aad6710d1eb0affa => generated 530 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:42.376355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d3118-31c6-4cc6-92fc-71d1d304300f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:42.415805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d7a79-8fd5-49b4-af83-273a81f08589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:42.416449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d7a79-8fd5-49b4-af83-273a81f08589 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:42.416721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d7a79-8fd5-49b4-af83-273a81f08589 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:42.416990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d7a79-8fd5-49b4-af83-273a81f08589 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:42.417657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d7a79-8fd5-49b4-af83-273a81f08589 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:42.419176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d7a79-8fd5-49b4-af83-273a81f08589 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:42.452236 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:28:42 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:28:44.717520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439e70-cb54-489d-9214-8a463a745b42 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:44.718047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439e70-cb54-489d-9214-8a463a745b42 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:44.718047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439e70-cb54-489d-9214-8a463a745b42 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:44.719405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 23/47] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:44.725228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e965c1-d3d3-43f6-b643-b2188c992bc7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:44.725717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e965c1-d3d3-43f6-b643-b2188c992bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:44.725798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e965c1-d3d3-43f6-b643-b2188c992bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:44.744504 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b7e965c1-d3d3-43f6-b643-b2188c992bc7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:44.745720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b7e965c1-d3d3-43f6-b643-b2188c992bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:44.771472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:44.820679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 25/48] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:28:45.086736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439e70-cb54-489d-9214-8a463a745b42 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:45.197863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439e70-cb54-489d-9214-8a463a745b42 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:45.233131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89661841-3502-4be9-a6a1-dc80f6739773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:45.233765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89661841-3502-4be9-a6a1-dc80f6739773 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:45.234044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89661841-3502-4be9-a6a1-dc80f6739773 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:45.234318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89661841-3502-4be9-a6a1-dc80f6739773 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:45.235473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89661841-3502-4be9-a6a1-dc80f6739773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:45.236936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89661841-3502-4be9-a6a1-dc80f6739773 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:45.238561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 24/49] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:28:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:45.245166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e965c1-d3d3-43f6-b643-b2188c992bc7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:45.347912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e965c1-d3d3-43f6-b643-b2188c992bc7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:45.384530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a97a70-a63b-4283-b271-b03e3ace24c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:45.385184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a97a70-a63b-4283-b271-b03e3ace24c8 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:45.385437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a97a70-a63b-4283-b271-b03e3ace24c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:45.385698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a97a70-a63b-4283-b271-b03e3ace24c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:45.386359 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a97a70-a63b-4283-b271-b03e3ace24c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:45.387842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a97a70-a63b-4283-b271-b03e3ace24c8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:45.417180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1140 bytes} [Mon Oct 24 13:28:45 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:28:47.605049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea88b-905a-4234-8157-b59a814c8b8b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:47.605633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea88b-905a-4234-8157-b59a814c8b8b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:47.605633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea88b-905a-4234-8157-b59a814c8b8b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:47.606943 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 25/51] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:47.612581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b4ba9-5067-4059-bfbe-29acdbd3890c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:47.613023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b4ba9-5067-4059-bfbe-29acdbd3890c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:47.613130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b4ba9-5067-4059-bfbe-29acdbd3890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:47.633131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-887b4ba9-5067-4059-bfbe-29acdbd3890c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:47.634273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-887b4ba9-5067-4059-bfbe-29acdbd3890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:47.642798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:47.712578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 27/52] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:47.978639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea88b-905a-4234-8157-b59a814c8b8b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:48.007320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:48.097972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea88b-905a-4234-8157-b59a814c8b8b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:48.136502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5633469-c417-4e00-8596-476d53df507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:48.137142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5633469-c417-4e00-8596-476d53df507a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:48.137421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5633469-c417-4e00-8596-476d53df507a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:48.137690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5633469-c417-4e00-8596-476d53df507a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:48.138836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5633469-c417-4e00-8596-476d53df507a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:48.140351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5633469-c417-4e00-8596-476d53df507a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:48.141934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:48.147840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b4ba9-5067-4059-bfbe-29acdbd3890c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:48.260606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b4ba9-5067-4059-bfbe-29acdbd3890c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:48.297375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628b51-13b2-47de-a047-1310ac5cb956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:48.297997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628b51-13b2-47de-a047-1310ac5cb956 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:48.298260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628b51-13b2-47de-a047-1310ac5cb956 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:48.298513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628b51-13b2-47de-a047-1310ac5cb956 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:48.299203 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e628b51-13b2-47de-a047-1310ac5cb956 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:48.300672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e628b51-13b2-47de-a047-1310ac5cb956 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:48.326704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:48.332349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 28/54] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:28:48 2022] POST /identity/v3/users => generated 275 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:28:51.851562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d2a10-db0f-43c4-a7a4-190a283a4e92 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:51.852739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d2a10-db0f-43c4-a7a4-190a283a4e92 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:51.853321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d2a10-db0f-43c4-a7a4-190a283a4e92 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:51.854964 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 27/55] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:51.860749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc7b3-4379-471b-a326-9ce4bc1a4a2a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:51.861204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc7b3-4379-471b-a326-9ce4bc1a4a2a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:51.861274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc7b3-4379-471b-a326-9ce4bc1a4a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:51.885711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-145dc7b3-4379-471b-a326-9ce4bc1a4a2a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:51.886989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-145dc7b3-4379-471b-a326-9ce4bc1a4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:51.983282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 29/56] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:52.031881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc6cb-8dd0-43a0-8940-b3762601a393 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.032492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc6cb-8dd0-43a0-8940-b3762601a393 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.032958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc6cb-8dd0-43a0-8940-b3762601a393 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.034532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 28/57] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:52.040262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6268cf-ccb4-4784-8cf4-a64fd0ffa95e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.040551 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6268cf-ccb4-4784-8cf4-a64fd0ffa95e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.040820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6268cf-ccb4-4784-8cf4-a64fd0ffa95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.207909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ff6268cf-ccb4-4784-8cf4-a64fd0ffa95e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:52.209057 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ff6268cf-ccb4-4784-8cf4-a64fd0ffa95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:52.240667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed29ca9-e031-4194-ae0b-eb3983fc98b1 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.241570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed29ca9-e031-4194-ae0b-eb3983fc98b1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.242277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed29ca9-e031-4194-ae0b-eb3983fc98b1 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.245092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 29/58] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:52.254634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e28a62-20e5-4068-820a-7701062801dc None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.255500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e28a62-20e5-4068-820a-7701062801dc None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.256211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e28a62-20e5-4068-820a-7701062801dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.288953 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-65e28a62-20e5-4068-820a-7701062801dc None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:52.291497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-65e28a62-20e5-4068-820a-7701062801dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:52.322545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 30/59] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:52.323721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cd6ec-3c8d-4a38-8845-565264382022 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.324012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cd6ec-3c8d-4a38-8845-565264382022 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.324287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cd6ec-3c8d-4a38-8845-565264382022 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.325560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 31/60] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:52.326270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cd6ec-3c8d-4a38-8845-565264382022 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:52.382045 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 30/61] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:28:52.383914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813e9e0-0bf7-4f75-9a3d-46bec03ab97f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.384349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813e9e0-0bf7-4f75-9a3d-46bec03ab97f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.384848 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813e9e0-0bf7-4f75-9a3d-46bec03ab97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.406896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4813e9e0-0bf7-4f75-9a3d-46bec03ab97f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:52.408723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4813e9e0-0bf7-4f75-9a3d-46bec03ab97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:52.430840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:52.432808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:52.516430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 31/62] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:52.524721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cd6ec-3c8d-4a38-8845-565264382022 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:52.563275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31886452-5309-4f68-8a41-54af41ed87d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:52.564217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31886452-5309-4f68-8a41-54af41ed87d4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.564689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31886452-5309-4f68-8a41-54af41ed87d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.565147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31886452-5309-4f68-8a41-54af41ed87d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.578443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31886452-5309-4f68-8a41-54af41ed87d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-31886452-5309-4f68-8a41-54af41ed87d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:52.585411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:52.586467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:28:52.587585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:52.589566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 32/63] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:28:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:28:52.595584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813e9e0-0bf7-4f75-9a3d-46bec03ab97f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:52.694240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31886452-5309-4f68-8a41-54af41ed87d4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:52.728466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813e9e0-0bf7-4f75-9a3d-46bec03ab97f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:52.775395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f942b4-cc06-4069-850b-616fa0986207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:52.776392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f942b4-cc06-4069-850b-616fa0986207 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.777322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f942b4-cc06-4069-850b-616fa0986207 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.777322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f942b4-cc06-4069-850b-616fa0986207 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.777883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f942b4-cc06-4069-850b-616fa0986207 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:52.778280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f942b4-cc06-4069-850b-616fa0986207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:52.780158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f942b4-cc06-4069-850b-616fa0986207 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:52.789860 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 32/64] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:28:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:52.790893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f942b4-cc06-4069-850b-616fa0986207 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:52.809514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:52.861953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31886452-5309-4f68-8a41-54af41ed87d4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:52.886012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:52.922859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86b82-45b8-4659-a305-261122073db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:52.924228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86b82-45b8-4659-a305-261122073db5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.924650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86b82-45b8-4659-a305-261122073db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.925061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86b82-45b8-4659-a305-261122073db5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.926656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f942b4-cc06-4069-850b-616fa0986207 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:52.939815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d86b82-45b8-4659-a305-261122073db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-32d86b82-45b8-4659-a305-261122073db5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:52.947829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:52.948821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:52.949658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 33/65] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:28:52.950879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86b82-45b8-4659-a305-261122073db5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:52.971687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4b73c-7ae2-496e-a9d5-0770c2e9f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:52.972109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4b73c-7ae2-496e-a9d5-0770c2e9f2fd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:52.972385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4b73c-7ae2-496e-a9d5-0770c2e9f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:52.972669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4b73c-7ae2-496e-a9d5-0770c2e9f2fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:52.985640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4b73c-7ae2-496e-a9d5-0770c2e9f2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-61a4b73c-7ae2-496e-a9d5-0770c2e9f2fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:52.991142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:52.991976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:28:52.992885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 33/66] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:28:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:28:52.993741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4b73c-7ae2-496e-a9d5-0770c2e9f2fd None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.084144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:53.090408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86b82-45b8-4659-a305-261122073db5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:53.110401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4b73c-7ae2-496e-a9d5-0770c2e9f2fd None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:53.127445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b99d7-d3c4-4786-935b-d1796d01c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:53.128099 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b99d7-d3c4-4786-935b-d1796d01c782 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.128373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b99d7-d3c4-4786-935b-d1796d01c782 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.128644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b99d7-d3c4-4786-935b-d1796d01c782 None admin] PATH_INFO: `/v3/users/a81ae024eaed4561b6054d1bab23312a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.148737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70fe0b-f60a-42a3-877e-bb878d6c29fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:53.149645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fe0b-f60a-42a3-877e-bb878d6c29fc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.149753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b99d7-d3c4-4786-935b-d1796d01c782 None admin] RBAC: Authorizing `identity:get_user(user_id=a81ae024eaed4561b6054d1bab23312a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:53.150079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fe0b-f60a-42a3-877e-bb878d6c29fc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.150362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fe0b-f60a-42a3-877e-bb878d6c29fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.151337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b99d7-d3c4-4786-935b-d1796d01c782 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:53.153066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 34/67] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:28:52 2022] GET /identity/v3/users/a81ae024eaed4561b6054d1bab23312a => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:53.153845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b99d7-d3c4-4786-935b-d1796d01c782 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.174995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70fe0b-f60a-42a3-877e-bb878d6c29fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-fa70fe0b-f60a-42a3-877e-bb878d6c29fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:53.180079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:53.181107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:28:53.181852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 34/68] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:28:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:28:53.183086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca95be-d8b8-48e2-994a-3ae76ffb8499 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.183354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca95be-d8b8-48e2-994a-3ae76ffb8499 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.183626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca95be-d8b8-48e2-994a-3ae76ffb8499 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.186180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 35/69] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:53.186180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca95be-d8b8-48e2-994a-3ae76ffb8499 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.193389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:53.282340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b99d7-d3c4-4786-935b-d1796d01c782 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:53.302804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca95be-d8b8-48e2-994a-3ae76ffb8499 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:53.318486 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01055b-4f00-4193-aafa-4ee39374c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:53.319630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01055b-4f00-4193-aafa-4ee39374c024 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.320171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01055b-4f00-4193-aafa-4ee39374c024 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.320546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01055b-4f00-4193-aafa-4ee39374c024 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.321978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01055b-4f00-4193-aafa-4ee39374c024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:53.322270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01055b-4f00-4193-aafa-4ee39374c024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:53.323741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01055b-4f00-4193-aafa-4ee39374c024 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:53.336907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 35/70] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:53.342023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01055b-4f00-4193-aafa-4ee39374c024 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.344005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2ed06-00e5-40ea-8ce5-0eee9ebd81a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:53.344627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2ed06-00e5-40ea-8ce5-0eee9ebd81a0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.344907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2ed06-00e5-40ea-8ce5-0eee9ebd81a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.345182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2ed06-00e5-40ea-8ce5-0eee9ebd81a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.345857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2ed06-00e5-40ea-8ce5-0eee9ebd81a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:53.346162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2ed06-00e5-40ea-8ce5-0eee9ebd81a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:53.347705 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2ed06-00e5-40ea-8ce5-0eee9ebd81a0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:53.349498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:53.359303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 36/71] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:28:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:53.360169 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2ed06-00e5-40ea-8ce5-0eee9ebd81a0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.461921 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:53.464944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01055b-4f00-4193-aafa-4ee39374c024 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:53.469846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2ed06-00e5-40ea-8ce5-0eee9ebd81a0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:53.503954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d170fc2-4245-4b02-9e94-987abb88dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:53.504597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d170fc2-4245-4b02-9e94-987abb88dae0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.504873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d170fc2-4245-4b02-9e94-987abb88dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.505143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d170fc2-4245-4b02-9e94-987abb88dae0 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.506282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d170fc2-4245-4b02-9e94-987abb88dae0 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:53.507252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6b9aa-98f5-4c16-b7aa-4668f669239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:53.507802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d170fc2-4245-4b02-9e94-987abb88dae0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:53.507975 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6b9aa-98f5-4c16-b7aa-4668f669239d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.508415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6b9aa-98f5-4c16-b7aa-4668f669239d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.508749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6b9aa-98f5-4c16-b7aa-4668f669239d None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.509490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6b9aa-98f5-4c16-b7aa-4668f669239d None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:53.509681 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 36/72] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:28:53 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:53.509939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6b9aa-98f5-4c16-b7aa-4668f669239d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:53.511585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6b9aa-98f5-4c16-b7aa-4668f669239d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:53.515987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e8366-008a-4115-ad41-7b8c3d4b637b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.516269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e8366-008a-4115-ad41-7b8c3d4b637b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.516543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e8366-008a-4115-ad41-7b8c3d4b637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.521244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 37/73] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:28:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:53.522016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6b9aa-98f5-4c16-b7aa-4668f669239d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.537606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e25e8366-008a-4115-ad41-7b8c3d4b637b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:53.539324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e25e8366-008a-4115-ad41-7b8c3d4b637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:53.584186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:53.616222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 37/74] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:53.616953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e8366-008a-4115-ad41-7b8c3d4b637b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.645454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6b9aa-98f5-4c16-b7aa-4668f669239d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:53.687562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b902d-a0d8-49e2-8405-ae640fdb56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:53.688214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b902d-a0d8-49e2-8405-ae640fdb56ca None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.688506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b902d-a0d8-49e2-8405-ae640fdb56ca None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.688762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b902d-a0d8-49e2-8405-ae640fdb56ca None admin] PATH_INFO: `/v3/users/5707d799f4af482d868dd62b5ec82b2f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.689931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b902d-a0d8-49e2-8405-ae640fdb56ca None admin] RBAC: Authorizing `identity:get_user(user_id=5707d799f4af482d868dd62b5ec82b2f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:53.691454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b902d-a0d8-49e2-8405-ae640fdb56ca None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:53.698111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 38/75] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:28:53 2022] GET /identity/v3/users/5707d799f4af482d868dd62b5ec82b2f => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:53.698111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b902d-a0d8-49e2-8405-ae640fdb56ca None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.735749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:53.743708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e8366-008a-4115-ad41-7b8c3d4b637b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:53.791933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91943904-4adc-4ce6-9598-b2f786331459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:53.792923 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91943904-4adc-4ce6-9598-b2f786331459 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.793199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91943904-4adc-4ce6-9598-b2f786331459 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.793472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91943904-4adc-4ce6-9598-b2f786331459 None admin] PATH_INFO: `/v3/users/a81ae024eaed4561b6054d1bab23312a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.794686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91943904-4adc-4ce6-9598-b2f786331459 None admin] RBAC: Authorizing `identity:get_user(user_id=a81ae024eaed4561b6054d1bab23312a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:53.796213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91943904-4adc-4ce6-9598-b2f786331459 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:53.802629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 38/76] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:28:53 2022] GET /identity/v3/users/a81ae024eaed4561b6054d1bab23312a => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:53.802629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91943904-4adc-4ce6-9598-b2f786331459 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.837531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b902d-a0d8-49e2-8405-ae640fdb56ca None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:53.869821 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:53.880360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d356520-3bc0-4074-9dcf-1fa35bc30a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:53.881360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d356520-3bc0-4074-9dcf-1fa35bc30a3d None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:53.881942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d356520-3bc0-4074-9dcf-1fa35bc30a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:53.882382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d356520-3bc0-4074-9dcf-1fa35bc30a3d None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a/users/a81ae024eaed4561b6054d1bab23312a/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:53.884872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d356520-3bc0-4074-9dcf-1fa35bc30a3d None admin] RBAC: Authorizing `identity:create_grant(project_id=e8e96fe574b24452931740084b1af95a, user_id=a81ae024eaed4561b6054d1bab23312a, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:53.886360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d356520-3bc0-4074-9dcf-1fa35bc30a3d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:53.901328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 39/77] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:28:53 2022] PUT /identity/v3/projects/e8e96fe574b24452931740084b1af95a/users/a81ae024eaed4561b6054d1bab23312a/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:28:53.901853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d356520-3bc0-4074-9dcf-1fa35bc30a3d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:53.957539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91943904-4adc-4ce6-9598-b2f786331459 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:54.002807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6be1-d6eb-4dad-97c1-1f6989995011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:54.003507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6be1-d6eb-4dad-97c1-1f6989995011 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:54.003784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6be1-d6eb-4dad-97c1-1f6989995011 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:54.004054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6be1-d6eb-4dad-97c1-1f6989995011 None admin] PATH_INFO: `/v3/users/a81ae024eaed4561b6054d1bab23312a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:54.005482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c6be1-d6eb-4dad-97c1-1f6989995011 None admin] RBAC: Authorizing `identity:get_user(user_id=a81ae024eaed4561b6054d1bab23312a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:54.007073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c6be1-d6eb-4dad-97c1-1f6989995011 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:54.009116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 39/78] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:28:53 2022] GET /identity/v3/users/a81ae024eaed4561b6054d1bab23312a => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:54.014865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6be1-d6eb-4dad-97c1-1f6989995011 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:54.042707 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d356520-3bc0-4074-9dcf-1fa35bc30a3d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:54.062637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:54.095324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde7db-a025-4e64-9a42-f963d18669e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:54.096617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde7db-a025-4e64-9a42-f963d18669e3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:54.097122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde7db-a025-4e64-9a42-f963d18669e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:54.097621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde7db-a025-4e64-9a42-f963d18669e3 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:54.099085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bde7db-a025-4e64-9a42-f963d18669e3 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:54.100612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bde7db-a025-4e64-9a42-f963d18669e3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:54.102794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 40/79] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:28:53 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:54.103620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde7db-a025-4e64-9a42-f963d18669e3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:54.158892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6be1-d6eb-4dad-97c1-1f6989995011 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:54.183492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:54.198982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2c112-d838-493f-b420-150fbd539419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:54.200055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2c112-d838-493f-b420-150fbd539419 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:54.200481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2c112-d838-493f-b420-150fbd539419 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:54.200889 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2c112-d838-493f-b420-150fbd539419 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:54.202893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2c112-d838-493f-b420-150fbd539419 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:54.204925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2c112-d838-493f-b420-150fbd539419 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:54.213812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 40/80] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:28:54 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:54.213812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2c112-d838-493f-b420-150fbd539419 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:54.246507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde7db-a025-4e64-9a42-f963d18669e3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:54.286525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662e600-85d7-45ba-b921-d7c8fae25053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:54.287702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662e600-85d7-45ba-b921-d7c8fae25053 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:54.288082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662e600-85d7-45ba-b921-d7c8fae25053 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:54.288460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662e600-85d7-45ba-b921-d7c8fae25053 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:54.289706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662e600-85d7-45ba-b921-d7c8fae25053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:54.291703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662e600-85d7-45ba-b921-d7c8fae25053 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:54.293712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 41/81] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:28:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:54.294271 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662e600-85d7-45ba-b921-d7c8fae25053 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:54.377413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:54.388248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2c112-d838-493f-b420-150fbd539419 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:54.437269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662e600-85d7-45ba-b921-d7c8fae25053 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:54.438366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26994d-29dd-4d0d-b31a-9f2199fb8025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:54.439130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26994d-29dd-4d0d-b31a-9f2199fb8025 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:54.439472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26994d-29dd-4d0d-b31a-9f2199fb8025 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:54.439812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26994d-29dd-4d0d-b31a-9f2199fb8025 None admin] PATH_INFO: `/v3/projects/52d0afad381d4739b6860d05be6caee4` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:54.441044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26994d-29dd-4d0d-b31a-9f2199fb8025 None admin] RBAC: Authorizing `identity:get_project(project_id=52d0afad381d4739b6860d05be6caee4)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:54.442500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26994d-29dd-4d0d-b31a-9f2199fb8025 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:54.444240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 41/82] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:28:54 2022] GET /identity/v3/projects/52d0afad381d4739b6860d05be6caee4 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:54.445020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26994d-29dd-4d0d-b31a-9f2199fb8025 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:54.472287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:54.488431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d23be3-3eda-44d2-8016-99559cb42438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:54.489244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d23be3-3eda-44d2-8016-99559cb42438 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:54.489531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d23be3-3eda-44d2-8016-99559cb42438 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:54.489806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d23be3-3eda-44d2-8016-99559cb42438 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a/users/5707d799f4af482d868dd62b5ec82b2f/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:54.491908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d23be3-3eda-44d2-8016-99559cb42438 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8e96fe574b24452931740084b1af95a, user_id=5707d799f4af482d868dd62b5ec82b2f, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:54.493473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d23be3-3eda-44d2-8016-99559cb42438 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:54.511022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 42/83] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:28:54 2022] PUT /identity/v3/projects/e8e96fe574b24452931740084b1af95a/users/5707d799f4af482d868dd62b5ec82b2f/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:28:54.511883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d23be3-3eda-44d2-8016-99559cb42438 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:54.591789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26994d-29dd-4d0d-b31a-9f2199fb8025 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:54.640181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683f1e9-d9ce-4fa8-82b5-6718172d6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:54.641202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683f1e9-d9ce-4fa8-82b5-6718172d6e1a None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:54.641479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683f1e9-d9ce-4fa8-82b5-6718172d6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:54.641770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683f1e9-d9ce-4fa8-82b5-6718172d6e1a None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a/users/a81ae024eaed4561b6054d1bab23312a/roles/53001a60e154408cbe7ea6ad0f2d7e0f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:54.644094 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683f1e9-d9ce-4fa8-82b5-6718172d6e1a None admin] RBAC: Authorizing `identity:create_grant(project_id=e8e96fe574b24452931740084b1af95a, user_id=a81ae024eaed4561b6054d1bab23312a, role_id=53001a60e154408cbe7ea6ad0f2d7e0f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:54.645592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683f1e9-d9ce-4fa8-82b5-6718172d6e1a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:54.676375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 42/84] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:28:54 2022] PUT /identity/v3/projects/e8e96fe574b24452931740084b1af95a/users/a81ae024eaed4561b6054d1bab23312a/roles/53001a60e154408cbe7ea6ad0f2d7e0f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:28:54.677899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683f1e9-d9ce-4fa8-82b5-6718172d6e1a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:54.705841 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d23be3-3eda-44d2-8016-99559cb42438 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:54.779703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:54.806178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f926f56-86fe-48ee-a871-1c644f012ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:54.807279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f926f56-86fe-48ee-a871-1c644f012ea1 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:54.807782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f926f56-86fe-48ee-a871-1c644f012ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:54.808250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f926f56-86fe-48ee-a871-1c644f012ea1 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:54.809416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f926f56-86fe-48ee-a871-1c644f012ea1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:54.813917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f926f56-86fe-48ee-a871-1c644f012ea1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:54.870674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 43/85] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:28:54 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:28:54.926508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683f1e9-d9ce-4fa8-82b5-6718172d6e1a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:54.972395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732d824-057f-4f60-a684-e85fc42afb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:54.973895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732d824-057f-4f60-a684-e85fc42afb13 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:54.974398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732d824-057f-4f60-a684-e85fc42afb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:54.974900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732d824-057f-4f60-a684-e85fc42afb13 None admin] PATH_INFO: `/v3/projects/52d0afad381d4739b6860d05be6caee4/users/a81ae024eaed4561b6054d1bab23312a/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:54.978975 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732d824-057f-4f60-a684-e85fc42afb13 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d0afad381d4739b6860d05be6caee4, user_id=a81ae024eaed4561b6054d1bab23312a, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:54.980862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732d824-057f-4f60-a684-e85fc42afb13 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:55.000969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 43/86] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:28:54 2022] PUT /identity/v3/projects/52d0afad381d4739b6860d05be6caee4/users/a81ae024eaed4561b6054d1bab23312a/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:28:57.217328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58210f4a-0d0a-458a-9323-c0be7aa28fd6 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:57.218982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58210f4a-0d0a-458a-9323-c0be7aa28fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:57.219771 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58210f4a-0d0a-458a-9323-c0be7aa28fd6 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:57.222684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 44/87] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:57.229963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d3833-c0f5-442c-9bbd-926043994ec9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:57.231502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d3833-c0f5-442c-9bbd-926043994ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:57.232311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d3833-c0f5-442c-9bbd-926043994ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:57.274346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-122d3833-c0f5-442c-9bbd-926043994ec9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:57.276975 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-122d3833-c0f5-442c-9bbd-926043994ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:57.378822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 44/88] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:57.633956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7ea36-232c-4b50-8980-2f911f9a03d3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:57.634320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7ea36-232c-4b50-8980-2f911f9a03d3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:57.634506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7ea36-232c-4b50-8980-2f911f9a03d3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:57.636044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 45/89] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:57.652958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b2e5a-8e81-4466-8f16-83b01af77e5b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:57.653252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b2e5a-8e81-4466-8f16-83b01af77e5b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:57.653516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b2e5a-8e81-4466-8f16-83b01af77e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:57.684174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-444b2e5a-8e81-4466-8f16-83b01af77e5b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:57.685419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-444b2e5a-8e81-4466-8f16-83b01af77e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:57.701799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:57.785791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 45/90] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:57.881298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4825f0-852a-47eb-b545-70522df98c9b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:57.882049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4825f0-852a-47eb-b545-70522df98c9b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:57.882541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4825f0-852a-47eb-b545-70522df98c9b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:57.884363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 46/91] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:57.890497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf45f-16eb-43a7-b1a8-44240afd0dcb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:57.890774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf45f-16eb-43a7-b1a8-44240afd0dcb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:57.891089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf45f-16eb-43a7-b1a8-44240afd0dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:57.917093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a90cf45f-16eb-43a7-b1a8-44240afd0dcb None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:57.918334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a90cf45f-16eb-43a7-b1a8-44240afd0dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:57.931944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4825f0-852a-47eb-b545-70522df98c9b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:58.031933 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:58.038954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 46/92] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:58.135110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4825f0-852a-47eb-b545-70522df98c9b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:58.190540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1854b66-01a4-4560-9b2d-fc6371c630bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:58.191565 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1854b66-01a4-4560-9b2d-fc6371c630bd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:58.192017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1854b66-01a4-4560-9b2d-fc6371c630bd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:58.192484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1854b66-01a4-4560-9b2d-fc6371c630bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:58.209904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1854b66-01a4-4560-9b2d-fc6371c630bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d1854b66-01a4-4560-9b2d-fc6371c630bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:58.215497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:58.216347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:28:58.217111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:28:58.219529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 47/93] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:28:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:28:58.225778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cf45f-16eb-43a7-b1a8-44240afd0dcb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:58.228828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1854b66-01a4-4560-9b2d-fc6371c630bd None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:58.393072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:58.403477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:58.409519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1854b66-01a4-4560-9b2d-fc6371c630bd None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:58.447559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cf45f-16eb-43a7-b1a8-44240afd0dcb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:58.470985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c190c-9dfc-491d-82e5-68f5d865cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:58.472097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c190c-9dfc-491d-82e5-68f5d865cd6a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:58.472813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c190c-9dfc-491d-82e5-68f5d865cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:58.473533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c190c-9dfc-491d-82e5-68f5d865cd6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:58.488800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225221e-ae07-414d-90ca-8d4256d5d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:58.489680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225221e-ae07-414d-90ca-8d4256d5d57e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:58.490097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225221e-ae07-414d-90ca-8d4256d5d57e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:58.490535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225221e-ae07-414d-90ca-8d4256d5d57e None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:58.491398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225221e-ae07-414d-90ca-8d4256d5d57e None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:58.491845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225221e-ae07-414d-90ca-8d4256d5d57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:58.493555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c190c-9dfc-491d-82e5-68f5d865cd6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:58.493964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225221e-ae07-414d-90ca-8d4256d5d57e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-5a6c190c-9dfc-491d-82e5-68f5d865cd6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:58.503478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:58.505962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:28:58.508770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:28:58.510628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 47/94] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:28:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:58.510628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6a0d6-01d7-49e5-887c-9809da3a1f00 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:58.510628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6a0d6-01d7-49e5-887c-9809da3a1f00 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:58.511027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6a0d6-01d7-49e5-887c-9809da3a1f00 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:58.512576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 48/95] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:58.513373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6a0d6-01d7-49e5-887c-9809da3a1f00 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:58.522427 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 48/96] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:28:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:28:58.523824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c190c-9dfc-491d-82e5-68f5d865cd6a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:58.639809 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6a0d6-01d7-49e5-887c-9809da3a1f00 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:58.656664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c190c-9dfc-491d-82e5-68f5d865cd6a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:58.686081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a243a-66b1-48fb-888a-50f993af87ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:58.687106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a243a-66b1-48fb-888a-50f993af87ec None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:58.687597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a243a-66b1-48fb-888a-50f993af87ec None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:58.688038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a243a-66b1-48fb-888a-50f993af87ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:58.696739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:58.700088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40399da4-3a47-483a-8c3a-4274b7877969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:58.700944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40399da4-3a47-483a-8c3a-4274b7877969 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:58.701532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40399da4-3a47-483a-8c3a-4274b7877969 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:58.702083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40399da4-3a47-483a-8c3a-4274b7877969 None admin] PATH_INFO: `/v3/users/a81ae024eaed4561b6054d1bab23312a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:58.703315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a243a-66b1-48fb-888a-50f993af87ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:58.703506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40399da4-3a47-483a-8c3a-4274b7877969 None admin] RBAC: Authorizing `identity:get_user(user_id=a81ae024eaed4561b6054d1bab23312a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:58.704985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40399da4-3a47-483a-8c3a-4274b7877969 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:58.706768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 49/97] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:28:58 2022] GET /identity/v3/users/a81ae024eaed4561b6054d1bab23312a => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-156a243a-66b1-48fb-888a-50f993af87ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:58.709654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:58.710532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:28:58.711406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:58.713377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5be5-65d7-4073-975c-7a55de9abfa6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:58.713745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5be5-65d7-4073-975c-7a55de9abfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:58.714026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5be5-65d7-4073-975c-7a55de9abfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:58.714524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 49/98] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:28:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:28:58.715630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a243a-66b1-48fb-888a-50f993af87ec None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:58.738365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ba1d5be5-65d7-4073-975c-7a55de9abfa6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:58.740455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ba1d5be5-65d7-4073-975c-7a55de9abfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:58.772931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:58.829256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 50/99] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:58.830561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5be5-65d7-4073-975c-7a55de9abfa6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:58.854202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a243a-66b1-48fb-888a-50f993af87ec None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:58.893510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10485d-be11-43d4-86fe-be546ace43eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:58.894600 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10485d-be11-43d4-86fe-be546ace43eb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:58.895121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10485d-be11-43d4-86fe-be546ace43eb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:58.895634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10485d-be11-43d4-86fe-be546ace43eb None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:58.896508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10485d-be11-43d4-86fe-be546ace43eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:58.897011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10485d-be11-43d4-86fe-be546ace43eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:58.898839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10485d-be11-43d4-86fe-be546ace43eb None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:58.908989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 50/100] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:28:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:58.910281 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10485d-be11-43d4-86fe-be546ace43eb None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:58.962849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5be5-65d7-4073-975c-7a55de9abfa6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:58.996189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:59.006483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4d27f-5c7c-4fa8-bc96-3aa94709cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:59.007170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d27f-5c7c-4fa8-bc96-3aa94709cd93 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.007448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d27f-5c7c-4fa8-bc96-3aa94709cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.007719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d27f-5c7c-4fa8-bc96-3aa94709cd93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.078514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:59.100244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10485d-be11-43d4-86fe-be546ace43eb None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:59.158003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163390a-9c01-44d6-94ab-4337b4ac8485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:59.159380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163390a-9c01-44d6-94ab-4337b4ac8485 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.160177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163390a-9c01-44d6-94ab-4337b4ac8485 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.160683 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163390a-9c01-44d6-94ab-4337b4ac8485 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.162071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163390a-9c01-44d6-94ab-4337b4ac8485 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:28:59.162916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163390a-9c01-44d6-94ab-4337b4ac8485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:59.164937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163390a-9c01-44d6-94ab-4337b4ac8485 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:59.171685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4d27f-5c7c-4fa8-bc96-3aa94709cd93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:59.173325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4d27f-5c7c-4fa8-bc96-3aa94709cd93 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:59.177831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 51/101] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:28:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:59.178974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163390a-9c01-44d6-94ab-4337b4ac8485 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:59.301478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163390a-9c01-44d6-94ab-4337b4ac8485 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:59.303552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 51/102] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:28:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:59.306401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff41fc-d988-4927-845b-77fe9d1133aa None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.306681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff41fc-d988-4927-845b-77fe9d1133aa None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.306977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff41fc-d988-4927-845b-77fe9d1133aa None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.310988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 52/103] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:59.312653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff41fc-d988-4927-845b-77fe9d1133aa None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:59.326386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:59.338893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbae456-3cc2-4a7c-b39a-cd0cea8c4ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:59.339903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae456-3cc2-4a7c-b39a-cd0cea8c4ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.340332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae456-3cc2-4a7c-b39a-cd0cea8c4ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.340645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae456-3cc2-4a7c-b39a-cd0cea8c4ee8 None admin] PATH_INFO: `/v3/users/a81ae024eaed4561b6054d1bab23312a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.341988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbae456-3cc2-4a7c-b39a-cd0cea8c4ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=a81ae024eaed4561b6054d1bab23312a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:59.343976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbae456-3cc2-4a7c-b39a-cd0cea8c4ee8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:59.345988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 52/104] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:28:59 2022] GET /identity/v3/users/a81ae024eaed4561b6054d1bab23312a => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:59.346910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbae456-3cc2-4a7c-b39a-cd0cea8c4ee8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:59.378837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:59.439983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff41fc-d988-4927-845b-77fe9d1133aa None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:59.467429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbae456-3cc2-4a7c-b39a-cd0cea8c4ee8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:59.489718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b13aa9-e710-4021-a8b9-2e5a2cd12c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:59.490364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13aa9-e710-4021-a8b9-2e5a2cd12c19 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.490641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13aa9-e710-4021-a8b9-2e5a2cd12c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.490915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13aa9-e710-4021-a8b9-2e5a2cd12c19 None admin] PATH_INFO: `/v3/users/a81ae024eaed4561b6054d1bab23312a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.492125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b13aa9-e710-4021-a8b9-2e5a2cd12c19 None admin] RBAC: Authorizing `identity:get_user(user_id=a81ae024eaed4561b6054d1bab23312a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:59.494417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b13aa9-e710-4021-a8b9-2e5a2cd12c19 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:59.496074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 53/105] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:28:59 2022] GET /identity/v3/users/a81ae024eaed4561b6054d1bab23312a => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:59.501277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4582424-66bd-4e1e-bf54-c1c5d2c66539 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.501277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4582424-66bd-4e1e-bf54-c1c5d2c66539 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.501277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4582424-66bd-4e1e-bf54-c1c5d2c66539 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.501277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 54/106] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:28:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:28:59.501277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4582424-66bd-4e1e-bf54-c1c5d2c66539 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:59.514537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1c372-fe99-4c3d-8bbf-588a5c87a840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:59.515324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1c372-fe99-4c3d-8bbf-588a5c87a840 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.515673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1c372-fe99-4c3d-8bbf-588a5c87a840 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.515950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1c372-fe99-4c3d-8bbf-588a5c87a840 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.528550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1c372-fe99-4c3d-8bbf-588a5c87a840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-bff1c372-fe99-4c3d-8bbf-588a5c87a840 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:28:59.534323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:28:59.535401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:28:59.536272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 53/107] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:28:59.537096 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b378e-44da-4100-a2ef-ffdbe626c850 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.537096 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b378e-44da-4100-a2ef-ffdbe626c850 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.537228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b378e-44da-4100-a2ef-ffdbe626c850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.556892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ea3b378e-44da-4100-a2ef-ffdbe626c850 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:28:59.558112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ea3b378e-44da-4100-a2ef-ffdbe626c850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:28:59.610198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:59.630786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4582424-66bd-4e1e-bf54-c1c5d2c66539 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:59.651563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 54/108] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:59.651563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b378e-44da-4100-a2ef-ffdbe626c850 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:59.664440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:59.681756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473a03f-e0f3-4d08-bd6a-5dd9815e5ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:59.683180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473a03f-e0f3-4d08-bd6a-5dd9815e5ead None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.683604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473a03f-e0f3-4d08-bd6a-5dd9815e5ead None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.684052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473a03f-e0f3-4d08-bd6a-5dd9815e5ead None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.686114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473a03f-e0f3-4d08-bd6a-5dd9815e5ead None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:59.688844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473a03f-e0f3-4d08-bd6a-5dd9815e5ead None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:59.697116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 55/109] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:28:59 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:28:59.697116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473a03f-e0f3-4d08-bd6a-5dd9815e5ead None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:28:59.784643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b378e-44da-4100-a2ef-ffdbe626c850 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:59.813025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473a03f-e0f3-4d08-bd6a-5dd9815e5ead None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:28:59.830602 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b40f8a-6e29-4305-a6a5-5a8f3ec72119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:59.831643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40f8a-6e29-4305-a6a5-5a8f3ec72119 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.832078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40f8a-6e29-4305-a6a5-5a8f3ec72119 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.832467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40f8a-6e29-4305-a6a5-5a8f3ec72119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.855070 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b422c1d-bd6c-4ea4-b509-96a8726f4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:28:59.855765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b422c1d-bd6c-4ea4-b509-96a8726f4996 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:28:59.856040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b422c1d-bd6c-4ea4-b509-96a8726f4996 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:28:59.856523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b422c1d-bd6c-4ea4-b509-96a8726f4996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:28:59.893575 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:59.919330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b40f8a-6e29-4305-a6a5-5a8f3ec72119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:59.920814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b40f8a-6e29-4305-a6a5-5a8f3ec72119 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:28:59.927212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:59.937700 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b422c1d-bd6c-4ea4-b509-96a8726f4996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:28:59.939407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b422c1d-bd6c-4ea4-b509-96a8726f4996 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:00.031644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 55/110] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:00.032847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8647d-3bfe-4b43-9a63-c0107761f4d4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:00.033122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8647d-3bfe-4b43-9a63-c0107761f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:00.033578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8647d-3bfe-4b43-9a63-c0107761f4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:00.055473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3bd8647d-3bfe-4b43-9a63-c0107761f4d4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:00.056675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3bd8647d-3bfe-4b43-9a63-c0107761f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:00.059380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 56/111] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:00.064384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b422c1d-bd6c-4ea4-b509-96a8726f4996 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:00.136269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 56/112] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:00.137115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8647d-3bfe-4b43-9a63-c0107761f4d4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:00.163700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:00.165311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:00.177104 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b422c1d-bd6c-4ea4-b509-96a8726f4996 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:00.217895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e7e7-9207-466e-880a-ab6bae5ef672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:00.218599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e7e7-9207-466e-880a-ab6bae5ef672 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:00.218881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e7e7-9207-466e-880a-ab6bae5ef672 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:00.219186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e7e7-9207-466e-880a-ab6bae5ef672 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:00.219867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7e7e7-9207-466e-880a-ab6bae5ef672 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:00.220173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7e7e7-9207-466e-880a-ab6bae5ef672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:00.221576 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7e7e7-9207-466e-880a-ab6bae5ef672 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:00.231127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 57/113] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:00.232002 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e7e7-9207-466e-880a-ab6bae5ef672 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:00.263523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8647d-3bfe-4b43-9a63-c0107761f4d4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:00.324304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125ba33-8c2c-4cf2-823f-9b1f76285b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:00.325541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ba33-8c2c-4cf2-823f-9b1f76285b17 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:00.326164 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ba33-8c2c-4cf2-823f-9b1f76285b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:00.326580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ba33-8c2c-4cf2-823f-9b1f76285b17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:00.327739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125ba33-8c2c-4cf2-823f-9b1f76285b17 None admin] RBAC: Adding query filter params (role.id=28346cbeb7e94e25b52f586669c5beaa, scope.project.id=e8e96fe574b24452931740084b1af95a, user.id=a81ae024eaed4561b6054d1bab23312a) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:00.328220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125ba33-8c2c-4cf2-823f-9b1f76285b17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:00.330571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125ba33-8c2c-4cf2-823f-9b1f76285b17 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:00.354972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 57/114] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/role_assignments?user.id=a81ae024eaed4561b6054d1bab23312a&scope.project.id=e8e96fe574b24452931740084b1af95a&role.id=28346cbeb7e94e25b52f586669c5beaa => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:00.354972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125ba33-8c2c-4cf2-823f-9b1f76285b17 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:00.384931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e7e7-9207-466e-880a-ab6bae5ef672 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:00.428879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6318b-6be9-4f1f-94d8-5c8142deaee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:00.429545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6318b-6be9-4f1f-94d8-5c8142deaee1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:00.429824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6318b-6be9-4f1f-94d8-5c8142deaee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:00.430326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6318b-6be9-4f1f-94d8-5c8142deaee1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:00.450108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6318b-6be9-4f1f-94d8-5c8142deaee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b0f6318b-6be9-4f1f-94d8-5c8142deaee1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:00.455823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:00.456768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 58/115] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:00.463120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6318b-6be9-4f1f-94d8-5c8142deaee1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:00.484755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:00.491781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:00.525484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125ba33-8c2c-4cf2-823f-9b1f76285b17 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:00.572968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649a6f3-38dc-42e3-a68c-5040fa05c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:00.573625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649a6f3-38dc-42e3-a68c-5040fa05c101 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:00.573899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649a6f3-38dc-42e3-a68c-5040fa05c101 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:00.574249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649a6f3-38dc-42e3-a68c-5040fa05c101 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:00.576862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649a6f3-38dc-42e3-a68c-5040fa05c101 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:00.577605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649a6f3-38dc-42e3-a68c-5040fa05c101 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:00.579332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 58/116] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:00.580642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649a6f3-38dc-42e3-a68c-5040fa05c101 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:00.621594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6318b-6be9-4f1f-94d8-5c8142deaee1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:00.662077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eee65b-1a86-4d1b-bea3-15339f5371e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:00.662721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee65b-1a86-4d1b-bea3-15339f5371e8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:00.663055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee65b-1a86-4d1b-bea3-15339f5371e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:00.663326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee65b-1a86-4d1b-bea3-15339f5371e8 None admin] PATH_INFO: `/v3/projects/52d0afad381d4739b6860d05be6caee4` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:00.664639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eee65b-1a86-4d1b-bea3-15339f5371e8 None admin] RBAC: Authorizing `identity:get_project(project_id=52d0afad381d4739b6860d05be6caee4)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:00.666229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eee65b-1a86-4d1b-bea3-15339f5371e8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:00.667996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 59/117] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/projects/52d0afad381d4739b6860d05be6caee4 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:00.671736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eee65b-1a86-4d1b-bea3-15339f5371e8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:00.717943 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649a6f3-38dc-42e3-a68c-5040fa05c101 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:00.770187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:00.773387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5efb-9d57-4fc1-a6d3-07c5fa8324f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:00.774217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5efb-9d57-4fc1-a6d3-07c5fa8324f4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:00.774498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5efb-9d57-4fc1-a6d3-07c5fa8324f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:00.774773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5efb-9d57-4fc1-a6d3-07c5fa8324f4 None admin] PATH_INFO: `/v3/users/5707d799f4af482d868dd62b5ec82b2f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:00.776095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb5efb-9d57-4fc1-a6d3-07c5fa8324f4 None admin] RBAC: Authorizing `identity:get_user(user_id=5707d799f4af482d868dd62b5ec82b2f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:00.777580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb5efb-9d57-4fc1-a6d3-07c5fa8324f4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:00.779601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 59/118] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/users/5707d799f4af482d868dd62b5ec82b2f => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:00.780373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5efb-9d57-4fc1-a6d3-07c5fa8324f4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:00.797576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:00.798676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eee65b-1a86-4d1b-bea3-15339f5371e8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:00.842172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc5383-3f46-42f6-abd9-be0726d13089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:00.842759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5383-3f46-42f6-abd9-be0726d13089 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:00.843058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5383-3f46-42f6-abd9-be0726d13089 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:00.843317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5383-3f46-42f6-abd9-be0726d13089 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:00.844470 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc5383-3f46-42f6-abd9-be0726d13089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:00.845946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc5383-3f46-42f6-abd9-be0726d13089 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:00.847620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 60/119] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:00.848481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc5383-3f46-42f6-abd9-be0726d13089 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:00.905879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5efb-9d57-4fc1-a6d3-07c5fa8324f4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:00.954644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8a7a2-4bc3-4206-af23-6e124f32cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:00.955455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8a7a2-4bc3-4206-af23-6e124f32cf80 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:00.955737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8a7a2-4bc3-4206-af23-6e124f32cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:00.956327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8a7a2-4bc3-4206-af23-6e124f32cf80 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:00.957020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8a7a2-4bc3-4206-af23-6e124f32cf80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:00.957320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8a7a2-4bc3-4206-af23-6e124f32cf80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:00.958727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8a7a2-4bc3-4206-af23-6e124f32cf80 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:00.960909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc5383-3f46-42f6-abd9-be0726d13089 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:00.973124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 60/120] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:00.976502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8a7a2-4bc3-4206-af23-6e124f32cf80 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:01.003395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50bf5-70b1-44db-aae3-ad025f921ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:01.004340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50bf5-70b1-44db-aae3-ad025f921ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:01.004781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50bf5-70b1-44db-aae3-ad025f921ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:01.005217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50bf5-70b1-44db-aae3-ad025f921ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:01.006426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d50bf5-70b1-44db-aae3-ad025f921ac4 None admin] RBAC: Adding query filter params (role.id=53001a60e154408cbe7ea6ad0f2d7e0f, scope.project.id=e8e96fe574b24452931740084b1af95a, user.id=a81ae024eaed4561b6054d1bab23312a) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:01.006845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d50bf5-70b1-44db-aae3-ad025f921ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:01.008572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d50bf5-70b1-44db-aae3-ad025f921ac4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:01.014865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 61/121] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/role_assignments?user.id=a81ae024eaed4561b6054d1bab23312a&scope.project.id=e8e96fe574b24452931740084b1af95a&role.id=53001a60e154408cbe7ea6ad0f2d7e0f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:01.015795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50bf5-70b1-44db-aae3-ad025f921ac4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:01.034660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:01.084740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:01.116154 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8a7a2-4bc3-4206-af23-6e124f32cf80 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:01.144428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50bf5-70b1-44db-aae3-ad025f921ac4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:01.170451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeeb8df-4686-47a7-9640-94dcc82ec4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:01.171135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeb8df-4686-47a7-9640-94dcc82ec4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:01.171417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeb8df-4686-47a7-9640-94dcc82ec4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:01.171694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeb8df-4686-47a7-9640-94dcc82ec4b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:01.172450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeeb8df-4686-47a7-9640-94dcc82ec4b5 None admin] RBAC: Adding query filter params (role.id=28346cbeb7e94e25b52f586669c5beaa, scope.project.id=52d0afad381d4739b6860d05be6caee4, user.id=a81ae024eaed4561b6054d1bab23312a) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:01.172770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeeb8df-4686-47a7-9640-94dcc82ec4b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:01.174324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeeb8df-4686-47a7-9640-94dcc82ec4b5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:01.184522 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 61/122] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:00 2022] GET /identity/v3/role_assignments?user.id=a81ae024eaed4561b6054d1bab23312a&scope.project.id=52d0afad381d4739b6860d05be6caee4&role.id=28346cbeb7e94e25b52f586669c5beaa => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:01.185260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeeb8df-4686-47a7-9640-94dcc82ec4b5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:01.222880 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692d50-8959-4e5b-836a-b990a4326bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:01.223587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692d50-8959-4e5b-836a-b990a4326bdb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:01.223875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692d50-8959-4e5b-836a-b990a4326bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:01.224152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692d50-8959-4e5b-836a-b990a4326bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:01.317567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692d50-8959-4e5b-836a-b990a4326bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:01.320025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692d50-8959-4e5b-836a-b990a4326bdb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:01.340224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeeb8df-4686-47a7-9640-94dcc82ec4b5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:01.344383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:01.393657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7102fd-69af-4730-971b-f8fb4e3bea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:01.394087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7102fd-69af-4730-971b-f8fb4e3bea12 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:01.394369 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7102fd-69af-4730-971b-f8fb4e3bea12 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:01.394638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7102fd-69af-4730-971b-f8fb4e3bea12 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:01.395365 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7102fd-69af-4730-971b-f8fb4e3bea12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:01.396843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7102fd-69af-4730-971b-f8fb4e3bea12 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:01.409125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:01.443197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 62/123] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:29:01 2022] POST /identity/v3/projects => generated 302 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:01.443197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7102fd-69af-4730-971b-f8fb4e3bea12 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:01.474955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 62/124] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:01.481571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692d50-8959-4e5b-836a-b990a4326bdb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:01.589659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7102fd-69af-4730-971b-f8fb4e3bea12 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:01.630466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692d50-8959-4e5b-836a-b990a4326bdb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:01.639637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea0aab-765f-4a51-b001-cb039c6fac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:01.640402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea0aab-765f-4a51-b001-cb039c6fac0f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:01.640541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea0aab-765f-4a51-b001-cb039c6fac0f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:01.640763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea0aab-765f-4a51-b001-cb039c6fac0f None admin] PATH_INFO: `/v3/users/48a54e0af78543ef895648e3fa8ac89a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:01.647907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:01.660161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea0aab-765f-4a51-b001-cb039c6fac0f None admin] RBAC: Authorizing `identity:get_user(user_id=48a54e0af78543ef895648e3fa8ac89a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:01.661644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea0aab-765f-4a51-b001-cb039c6fac0f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:01.662770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 63/125] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:01 2022] GET /identity/v3/users/48a54e0af78543ef895648e3fa8ac89a => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:01.669656 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea0aab-765f-4a51-b001-cb039c6fac0f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:01.684801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614bd58-4402-48fa-9adf-540519360452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:01.685567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614bd58-4402-48fa-9adf-540519360452 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:01.685839 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614bd58-4402-48fa-9adf-540519360452 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:01.686114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614bd58-4402-48fa-9adf-540519360452 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:01.687348 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614bd58-4402-48fa-9adf-540519360452 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:01.688829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614bd58-4402-48fa-9adf-540519360452 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:01.695610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 63/126] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:01 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:01.697549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614bd58-4402-48fa-9adf-540519360452 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:01.734070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:01.807629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea0aab-765f-4a51-b001-cb039c6fac0f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:01.816149 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614bd58-4402-48fa-9adf-540519360452 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:01.857317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c832b1-eff1-4aca-8f77-7abdf125f375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:01.857965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c832b1-eff1-4aca-8f77-7abdf125f375 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:01.858241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c832b1-eff1-4aca-8f77-7abdf125f375 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:01.858516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c832b1-eff1-4aca-8f77-7abdf125f375 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:01.859310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35569f6-2d5f-47e5-b150-60ce39b86f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:01.859652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c832b1-eff1-4aca-8f77-7abdf125f375 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:01.859931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35569f6-2d5f-47e5-b150-60ce39b86f17 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:01.860212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35569f6-2d5f-47e5-b150-60ce39b86f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:01.860486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35569f6-2d5f-47e5-b150-60ce39b86f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:01.861119 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c832b1-eff1-4aca-8f77-7abdf125f375 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:01.861270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35569f6-2d5f-47e5-b150-60ce39b86f17 None admin] RBAC: Adding query filter params (role.id=581091dd624142d3aad6710d1eb0affa, scope.project.id=e8e96fe574b24452931740084b1af95a, user.id=5707d799f4af482d868dd62b5ec82b2f) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:01.861557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35569f6-2d5f-47e5-b150-60ce39b86f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:01.863263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 64/127] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:01 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:01.863432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35569f6-2d5f-47e5-b150-60ce39b86f17 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:01.870946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 64/128] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:01 2022] GET /identity/v3/role_assignments?user.id=5707d799f4af482d868dd62b5ec82b2f&scope.project.id=e8e96fe574b24452931740084b1af95a&role.id=581091dd624142d3aad6710d1eb0affa => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:01.871763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c832b1-eff1-4aca-8f77-7abdf125f375 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:02.022441 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c832b1-eff1-4aca-8f77-7abdf125f375 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:02.044184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:02.069473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad8bab-515c-451f-a985-7f35e6df1186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:02.070218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad8bab-515c-451f-a985-7f35e6df1186 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:02.070501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad8bab-515c-451f-a985-7f35e6df1186 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:02.070777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad8bab-515c-451f-a985-7f35e6df1186 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a/users/48a54e0af78543ef895648e3fa8ac89a/roles/cdea924879894f8aa246be169f37b2b9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:02.072992 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad8bab-515c-451f-a985-7f35e6df1186 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8e96fe574b24452931740084b1af95a, user_id=48a54e0af78543ef895648e3fa8ac89a, role_id=cdea924879894f8aa246be169f37b2b9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:02.074441 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad8bab-515c-451f-a985-7f35e6df1186 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:02.090263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 65/129] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:01 2022] PUT /identity/v3/projects/e8e96fe574b24452931740084b1af95a/users/48a54e0af78543ef895648e3fa8ac89a/roles/cdea924879894f8aa246be169f37b2b9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:29:03.716293 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ab61b-9800-4c26-8b85-7a7f6e118808 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:03.716814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ab61b-9800-4c26-8b85-7a7f6e118808 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:03.716814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ab61b-9800-4c26-8b85-7a7f6e118808 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:03.718109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 65/130] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:03.732095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50a4f-6d6a-4e70-920f-de7b94ff82a6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:03.732095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50a4f-6d6a-4e70-920f-de7b94ff82a6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:03.732095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50a4f-6d6a-4e70-920f-de7b94ff82a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:03.743782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-18f50a4f-6d6a-4e70-920f-de7b94ff82a6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:03.744969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-18f50a4f-6d6a-4e70-920f-de7b94ff82a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:03.817074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 66/131] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:04.082090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ab61b-9800-4c26-8b85-7a7f6e118808 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:04.132872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:04.196384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ab61b-9800-4c26-8b85-7a7f6e118808 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:04.233770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e4aee-5d93-4d71-a888-590b1d59f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:04.234409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e4aee-5d93-4d71-a888-590b1d59f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:04.234687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e4aee-5d93-4d71-a888-590b1d59f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:04.234987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e4aee-5d93-4d71-a888-590b1d59f1b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:04.236106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e4aee-5d93-4d71-a888-590b1d59f1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:04.237563 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e4aee-5d93-4d71-a888-590b1d59f1b3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:04.239434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 66/132] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:04.245080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f50a4f-6d6a-4e70-920f-de7b94ff82a6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:04.271194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797836cf-303d-4b97-badf-0b382e83082a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:04.271435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797836cf-303d-4b97-badf-0b382e83082a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:04.271698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797836cf-303d-4b97-badf-0b382e83082a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:04.273061 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 67/133] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:04.280882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df987-7de9-4163-a0b7-603bb0785ea8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:04.281170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df987-7de9-4163-a0b7-603bb0785ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:04.281467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df987-7de9-4163-a0b7-603bb0785ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:04.302661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6c7df987-7de9-4163-a0b7-603bb0785ea8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:04.303912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6c7df987-7de9-4163-a0b7-603bb0785ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:04.368028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f50a4f-6d6a-4e70-920f-de7b94ff82a6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:04.377599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 68/134] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:04.389169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:04.427417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb36c5a-8db0-418a-af2f-1ab3ba3fc6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:04.428459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb36c5a-8db0-418a-af2f-1ab3ba3fc6e9 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:04.428945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb36c5a-8db0-418a-af2f-1ab3ba3fc6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:04.429425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb36c5a-8db0-418a-af2f-1ab3ba3fc6e9 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:04.430766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb36c5a-8db0-418a-af2f-1ab3ba3fc6e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:04.433538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb36c5a-8db0-418a-af2f-1ab3ba3fc6e9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:04.466996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 67/135] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:04 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:04.646201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df987-7de9-4163-a0b7-603bb0785ea8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:04.695966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:04.763616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df987-7de9-4163-a0b7-603bb0785ea8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:04.807258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008b2c5-6960-4c05-9efe-b92fd5ca3232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:04.807992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008b2c5-6960-4c05-9efe-b92fd5ca3232 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:04.808278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008b2c5-6960-4c05-9efe-b92fd5ca3232 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:04.808556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008b2c5-6960-4c05-9efe-b92fd5ca3232 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:04.822246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008b2c5-6960-4c05-9efe-b92fd5ca3232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-3008b2c5-6960-4c05-9efe-b92fd5ca3232 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:04.827765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:04.828706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:04.829583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 69/136] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:04.836817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb36c5a-8db0-418a-af2f-1ab3ba3fc6e9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:04.963638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb36c5a-8db0-418a-af2f-1ab3ba3fc6e9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:05.010842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35165-5651-45ab-ac0e-4767f28689b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:05.011899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35165-5651-45ab-ac0e-4767f28689b4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:05.012391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35165-5651-45ab-ac0e-4767f28689b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:05.012849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35165-5651-45ab-ac0e-4767f28689b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:05.013740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35165-5651-45ab-ac0e-4767f28689b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:05.014241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35165-5651-45ab-ac0e-4767f28689b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:05.015856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35165-5651-45ab-ac0e-4767f28689b4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:05.025854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 68/137] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:05.032468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008b2c5-6960-4c05-9efe-b92fd5ca3232 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:05.160064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008b2c5-6960-4c05-9efe-b92fd5ca3232 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:05.162634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:05.200868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac367fc-b6be-4b4e-864f-bdbaf338ca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:05.201515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac367fc-b6be-4b4e-864f-bdbaf338ca29 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:05.201791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac367fc-b6be-4b4e-864f-bdbaf338ca29 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:05.202066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac367fc-b6be-4b4e-864f-bdbaf338ca29 None admin] PATH_INFO: `/v3/users/48a54e0af78543ef895648e3fa8ac89a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:05.203243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac367fc-b6be-4b4e-864f-bdbaf338ca29 None admin] RBAC: Authorizing `identity:get_user(user_id=48a54e0af78543ef895648e3fa8ac89a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:05.204718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac367fc-b6be-4b4e-864f-bdbaf338ca29 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:05.206344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 70/138] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:05 2022] GET /identity/v3/users/48a54e0af78543ef895648e3fa8ac89a => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:05.212411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35165-5651-45ab-ac0e-4767f28689b4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:05.264318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:05.327211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35165-5651-45ab-ac0e-4767f28689b4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:05.386063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace3ae5-66d2-42ff-9e88-c81e4b369b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:05.386715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace3ae5-66d2-42ff-9e88-c81e4b369b00 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:05.387916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace3ae5-66d2-42ff-9e88-c81e4b369b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:05.387916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace3ae5-66d2-42ff-9e88-c81e4b369b00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:05.468394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace3ae5-66d2-42ff-9e88-c81e4b369b00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:05.470240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace3ae5-66d2-42ff-9e88-c81e4b369b00 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:05.498535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:05.597099 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 69/139] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:05.603457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac367fc-b6be-4b4e-864f-bdbaf338ca29 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:05.737366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac367fc-b6be-4b4e-864f-bdbaf338ca29 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:05.786205 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eadc6a-54ad-4d3f-83b2-0f801f3be317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:05.787709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eadc6a-54ad-4d3f-83b2-0f801f3be317 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:05.788230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eadc6a-54ad-4d3f-83b2-0f801f3be317 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:05.788678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eadc6a-54ad-4d3f-83b2-0f801f3be317 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:05.790529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eadc6a-54ad-4d3f-83b2-0f801f3be317 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:05.792564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eadc6a-54ad-4d3f-83b2-0f801f3be317 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:05.794901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 71/140] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:05 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:05.801427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace3ae5-66d2-42ff-9e88-c81e4b369b00 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:05.937078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace3ae5-66d2-42ff-9e88-c81e4b369b00 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:05.963863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:05.980252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0040c1-e306-4ff1-a020-4a84bb01ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:05.980879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0040c1-e306-4ff1-a020-4a84bb01ea09 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:05.981193 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0040c1-e306-4ff1-a020-4a84bb01ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:05.981421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0040c1-e306-4ff1-a020-4a84bb01ea09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:05.982680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0040c1-e306-4ff1-a020-4a84bb01ea09 None admin] RBAC: Adding query filter params (role.id=cdea924879894f8aa246be169f37b2b9, scope.project.id=e8e96fe574b24452931740084b1af95a, user.id=48a54e0af78543ef895648e3fa8ac89a) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:05.983263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0040c1-e306-4ff1-a020-4a84bb01ea09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:05.985696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0040c1-e306-4ff1-a020-4a84bb01ea09 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:05.994833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 70/141] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:05 2022] GET /identity/v3/role_assignments?user.id=48a54e0af78543ef895648e3fa8ac89a&scope.project.id=e8e96fe574b24452931740084b1af95a&role.id=cdea924879894f8aa246be169f37b2b9 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:07.109090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05443ca-c4dd-4eda-a195-d9e4cecc2ede None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.109630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05443ca-c4dd-4eda-a195-d9e4cecc2ede None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.109630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05443ca-c4dd-4eda-a195-d9e4cecc2ede None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.110985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 72/142] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:07.117166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a3dfa-3a9e-4021-9166-73344fa4162f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.117698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a3dfa-3a9e-4021-9166-73344fa4162f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.117772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a3dfa-3a9e-4021-9166-73344fa4162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.137753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-713a3dfa-3a9e-4021-9166-73344fa4162f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:07.138995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-713a3dfa-3a9e-4021-9166-73344fa4162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:07.149652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7745368-95cf-4c56-8755-f43d057e270c None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.149896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7745368-95cf-4c56-8755-f43d057e270c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.150195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7745368-95cf-4c56-8755-f43d057e270c None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.151731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 73/143] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:07.158665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcfbf9-bcad-4fb5-9262-b01edf2213c3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.158976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcfbf9-bcad-4fb5-9262-b01edf2213c3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.159256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcfbf9-bcad-4fb5-9262-b01edf2213c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.180911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b0bcfbf9-bcad-4fb5-9262-b01edf2213c3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:07.182137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b0bcfbf9-bcad-4fb5-9262-b01edf2213c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:07.221238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:07.227411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 71/144] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:07.228918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4e41-6e7e-40b8-8cac-21b935e5de9b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.229300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4e41-6e7e-40b8-8cac-21b935e5de9b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.229511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4e41-6e7e-40b8-8cac-21b935e5de9b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.230875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 72/145] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:07.236837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908aec1-29be-43a3-85f5-859c0f77777d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.237110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908aec1-29be-43a3-85f5-859c0f77777d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.237382 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908aec1-29be-43a3-85f5-859c0f77777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.260428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0908aec1-29be-43a3-85f5-859c0f77777d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:07.261636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0908aec1-29be-43a3-85f5-859c0f77777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:07.263579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 74/146] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:07.345481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 73/147] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:07.495035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcfbf9-bcad-4fb5-9262-b01edf2213c3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:07.548238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908aec1-29be-43a3-85f5-859c0f77777d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:07.604956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:07.628128 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcfbf9-bcad-4fb5-9262-b01edf2213c3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:07.661044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908aec1-29be-43a3-85f5-859c0f77777d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:07.671293 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ce989-8c53-4844-ae3e-13106ae35e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:07.671931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce989-8c53-4844-ae3e-13106ae35e09 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.672202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce989-8c53-4844-ae3e-13106ae35e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.672462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce989-8c53-4844-ae3e-13106ae35e09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.683490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ce989-8c53-4844-ae3e-13106ae35e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-746ce989-8c53-4844-ae3e-13106ae35e09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:07.688359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:07.689266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 75/148] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:29:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:07.690948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ce989-8c53-4844-ae3e-13106ae35e09 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:07.702076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565c5a9-36e7-4592-90e2-15f71e5788c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:07.702719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565c5a9-36e7-4592-90e2-15f71e5788c1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.702987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565c5a9-36e7-4592-90e2-15f71e5788c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.703252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565c5a9-36e7-4592-90e2-15f71e5788c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.704387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565c5a9-36e7-4592-90e2-15f71e5788c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:07.705832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565c5a9-36e7-4592-90e2-15f71e5788c1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:07.711918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 74/149] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:07.711918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565c5a9-36e7-4592-90e2-15f71e5788c1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:07.728078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:07.813596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ce989-8c53-4844-ae3e-13106ae35e09 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:07.817046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565c5a9-36e7-4592-90e2-15f71e5788c1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:07.835082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:07.851604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68699b-2a3a-42c4-aff8-5f9ff08940a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:07.852248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68699b-2a3a-42c4-aff8-5f9ff08940a9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.852513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68699b-2a3a-42c4-aff8-5f9ff08940a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.852775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68699b-2a3a-42c4-aff8-5f9ff08940a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.858300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce8ce0-d9e3-4dca-ba21-041bde2b605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:07.858300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8ce0-d9e3-4dca-ba21-041bde2b605f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:07.858300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8ce0-d9e3-4dca-ba21-041bde2b605f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:07.858300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8ce0-d9e3-4dca-ba21-041bde2b605f None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:07.858680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce8ce0-d9e3-4dca-ba21-041bde2b605f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:07.858680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce8ce0-d9e3-4dca-ba21-041bde2b605f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:07.858850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce8ce0-d9e3-4dca-ba21-041bde2b605f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:07.865976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68699b-2a3a-42c4-aff8-5f9ff08940a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:07.868439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 75/150] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:07.868775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce8ce0-d9e3-4dca-ba21-041bde2b605f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ce68699b-2a3a-42c4-aff8-5f9ff08940a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:07.871303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:07.872239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:07.873089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 76/151] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:07.873744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68699b-2a3a-42c4-aff8-5f9ff08940a9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:07.976766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:07.987353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68699b-2a3a-42c4-aff8-5f9ff08940a9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:07.998845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce8ce0-d9e3-4dca-ba21-041bde2b605f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:08.022348 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e59252-4634-4bd0-8edd-3a6f3f8b95b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:08.023013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e59252-4634-4bd0-8edd-3a6f3f8b95b8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:08.023291 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e59252-4634-4bd0-8edd-3a6f3f8b95b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:08.023562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e59252-4634-4bd0-8edd-3a6f3f8b95b8 None admin] PATH_INFO: `/v3/users/262683760c094321bb41e95bbd17304b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:08.034369 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626e3c-1a28-4e20-9287-cde2c3488603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:08.035018 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626e3c-1a28-4e20-9287-cde2c3488603 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:08.035288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626e3c-1a28-4e20-9287-cde2c3488603 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:08.035549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626e3c-1a28-4e20-9287-cde2c3488603 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:08.036198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5626e3c-1a28-4e20-9287-cde2c3488603 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:08.036866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e59252-4634-4bd0-8edd-3a6f3f8b95b8 None admin] RBAC: Authorizing `identity:get_user(user_id=262683760c094321bb41e95bbd17304b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:08.037641 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5626e3c-1a28-4e20-9287-cde2c3488603 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:08.038319 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e59252-4634-4bd0-8edd-3a6f3f8b95b8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:08.040309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 77/152] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:07 2022] GET /identity/v3/users/262683760c094321bb41e95bbd17304b => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:08.041082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e59252-4634-4bd0-8edd-3a6f3f8b95b8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:08.067524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 76/153] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:07 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:08.068459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626e3c-1a28-4e20-9287-cde2c3488603 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:08.119859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:08.181334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e59252-4634-4bd0-8edd-3a6f3f8b95b8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:08.218103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626e3c-1a28-4e20-9287-cde2c3488603 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:08.231321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3d437-2b32-4640-ad52-1d1c8f70f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:08.232283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3d437-2b32-4640-ad52-1d1c8f70f4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:08.232559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3d437-2b32-4640-ad52-1d1c8f70f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:08.232836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3d437-2b32-4640-ad52-1d1c8f70f4f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:08.233523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3d437-2b32-4640-ad52-1d1c8f70f4f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:08.233823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3d437-2b32-4640-ad52-1d1c8f70f4f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:08.235326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3d437-2b32-4640-ad52-1d1c8f70f4f2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:08.246720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 78/154] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:08.252646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3d437-2b32-4640-ad52-1d1c8f70f4f2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:08.264949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62a0f8-513e-4e75-8939-306b9a02b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:08.265610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62a0f8-513e-4e75-8939-306b9a02b56b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:08.265877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62a0f8-513e-4e75-8939-306b9a02b56b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:08.266144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62a0f8-513e-4e75-8939-306b9a02b56b None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:08.267326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62a0f8-513e-4e75-8939-306b9a02b56b None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:08.268792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62a0f8-513e-4e75-8939-306b9a02b56b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:08.270803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 77/155] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:08 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:08.276793 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62a0f8-513e-4e75-8939-306b9a02b56b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:08.279577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:08.419970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3d437-2b32-4640-ad52-1d1c8f70f4f2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:08.423589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62a0f8-513e-4e75-8939-306b9a02b56b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:08.426333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:08.475854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00aea9-d3a9-4a2e-b937-285b5f72a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:08.476554 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00aea9-d3a9-4a2e-b937-285b5f72a15a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:08.476889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00aea9-d3a9-4a2e-b937-285b5f72a15a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:08.477349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00aea9-d3a9-4a2e-b937-285b5f72a15a None admin] PATH_INFO: `/v3/users/262683760c094321bb41e95bbd17304b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:08.477496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb27677-e910-4ae4-bf06-f999ee489581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:08.478111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27677-e910-4ae4-bf06-f999ee489581 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:08.478385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27677-e910-4ae4-bf06-f999ee489581 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:08.478649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27677-e910-4ae4-bf06-f999ee489581 None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/users/262683760c094321bb41e95bbd17304b/roles/53001a60e154408cbe7ea6ad0f2d7e0f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:08.478736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00aea9-d3a9-4a2e-b937-285b5f72a15a None admin] RBAC: Authorizing `identity:get_user(user_id=262683760c094321bb41e95bbd17304b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:08.480177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00aea9-d3a9-4a2e-b937-285b5f72a15a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:08.480765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb27677-e910-4ae4-bf06-f999ee489581 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a370bf40ca4f53b61878f62d5d2333, user_id=262683760c094321bb41e95bbd17304b, role_id=53001a60e154408cbe7ea6ad0f2d7e0f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:08.482071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 79/156] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:08 2022] GET /identity/v3/users/262683760c094321bb41e95bbd17304b => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:08.482361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb27677-e910-4ae4-bf06-f999ee489581 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:08.488419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00aea9-d3a9-4a2e-b937-285b5f72a15a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:08.500652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 78/157] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:08 2022] PUT /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/users/262683760c094321bb41e95bbd17304b/roles/53001a60e154408cbe7ea6ad0f2d7e0f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:08.593983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:08.622200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00aea9-d3a9-4a2e-b937-285b5f72a15a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:08.664693 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec63a46-dbaf-46c5-8365-29a702f89b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:08.665927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec63a46-dbaf-46c5-8365-29a702f89b33 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:08.666399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec63a46-dbaf-46c5-8365-29a702f89b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:08.666856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec63a46-dbaf-46c5-8365-29a702f89b33 None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:08.668407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec63a46-dbaf-46c5-8365-29a702f89b33 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:08.670109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec63a46-dbaf-46c5-8365-29a702f89b33 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:08.672509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 80/158] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:08 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:08.680647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb27677-e910-4ae4-bf06-f999ee489581 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:08.809265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb27677-e910-4ae4-bf06-f999ee489581 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:08.856184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d35df-5df0-4084-bd0b-a773a18f759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:08.857308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d35df-5df0-4084-bd0b-a773a18f759d None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:08.857903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d35df-5df0-4084-bd0b-a773a18f759d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:08.858621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d35df-5df0-4084-bd0b-a773a18f759d None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/users/262683760c094321bb41e95bbd17304b/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:08.862521 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d35df-5df0-4084-bd0b-a773a18f759d None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a370bf40ca4f53b61878f62d5d2333, user_id=262683760c094321bb41e95bbd17304b, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:08.865643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d35df-5df0-4084-bd0b-a773a18f759d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:08.890751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 79/159] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:08 2022] PUT /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/users/262683760c094321bb41e95bbd17304b/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:10.488018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868de58-ff50-4fa0-bc0d-e9537bd2180d None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:10.488811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868de58-ff50-4fa0-bc0d-e9537bd2180d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:10.488811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868de58-ff50-4fa0-bc0d-e9537bd2180d None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:10.490164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 81/160] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:10.495955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a86a8-32d8-4b9b-8288-97f79d95ccfb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:10.496720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a86a8-32d8-4b9b-8288-97f79d95ccfb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:10.496720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a86a8-32d8-4b9b-8288-97f79d95ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:10.519992 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1d9a86a8-32d8-4b9b-8288-97f79d95ccfb None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:10.521692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1d9a86a8-32d8-4b9b-8288-97f79d95ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:10.541170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:10.599017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 80/161] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:10.762706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cdd99-d014-4e0b-9838-8374ffc5e9c7 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:10.763371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cdd99-d014-4e0b-9838-8374ffc5e9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:10.763863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cdd99-d014-4e0b-9838-8374ffc5e9c7 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:10.765852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 82/162] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:10.772355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea95e27-5556-42dd-a3af-94041b5a8f80 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:10.772976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea95e27-5556-42dd-a3af-94041b5a8f80 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:10.773511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea95e27-5556-42dd-a3af-94041b5a8f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:10.794448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0ea95e27-5556-42dd-a3af-94041b5a8f80 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:10.796054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0ea95e27-5556-42dd-a3af-94041b5a8f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:10.876546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cdd99-d014-4e0b-9838-8374ffc5e9c7 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:10.887028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 81/163] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:10.905720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dc74a-a240-42a4-9548-7152ffb7b308 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:10.906000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dc74a-a240-42a4-9548-7152ffb7b308 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:10.906361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dc74a-a240-42a4-9548-7152ffb7b308 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:10.907867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 82/164] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:29:10.912865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4acfd4-9c4b-4e9e-ad45-acf1e258301f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:10.913173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4acfd4-9c4b-4e9e-ad45-acf1e258301f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:10.913462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4acfd4-9c4b-4e9e-ad45-acf1e258301f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:10.936211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9b4acfd4-9c4b-4e9e-ad45-acf1e258301f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:10.937692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9b4acfd4-9c4b-4e9e-ad45-acf1e258301f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:11.049199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 83/165] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:29:11.067745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cdd99-d014-4e0b-9838-8374ffc5e9c7 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:11.115054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca77aa1-cc16-4828-a3d3-6633066d6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:11.115768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca77aa1-cc16-4828-a3d3-6633066d6a9c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.116047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca77aa1-cc16-4828-a3d3-6633066d6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.116317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca77aa1-cc16-4828-a3d3-6633066d6a9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.128150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca77aa1-cc16-4828-a3d3-6633066d6a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2ca77aa1-cc16-4828-a3d3-6633066d6a9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:11.134314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:11.135760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:11.136608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 83/166] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:11.148269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4acfd4-9c4b-4e9e-ad45-acf1e258301f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:11.166530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:11.221363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca77aa1-cc16-4828-a3d3-6633066d6a9c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:11.239542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:11.266060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4acfd4-9c4b-4e9e-ad45-acf1e258301f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:11.308553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959b563-58aa-4847-9779-55e76162ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:11.309579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959b563-58aa-4847-9779-55e76162ba60 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.310062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959b563-58aa-4847-9779-55e76162ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.310643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959b563-58aa-4847-9779-55e76162ba60 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.311595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959b563-58aa-4847-9779-55e76162ba60 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:11.312131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959b563-58aa-4847-9779-55e76162ba60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:11.313849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959b563-58aa-4847-9779-55e76162ba60 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:11.330661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 84/167] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:11.337923 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca77aa1-cc16-4828-a3d3-6633066d6a9c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:11.340110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959b563-58aa-4847-9779-55e76162ba60 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:11.398649 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b34cb8-ed3b-4a53-8aaa-0a474a50dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:11.401217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b34cb8-ed3b-4a53-8aaa-0a474a50dd89 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.401920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b34cb8-ed3b-4a53-8aaa-0a474a50dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.402644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b34cb8-ed3b-4a53-8aaa-0a474a50dd89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.405245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b34cb8-ed3b-4a53-8aaa-0a474a50dd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:11.407621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b34cb8-ed3b-4a53-8aaa-0a474a50dd89 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:11.409544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 84/168] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:11.419035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b34cb8-ed3b-4a53-8aaa-0a474a50dd89 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:11.436556 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:11.464186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959b563-58aa-4847-9779-55e76162ba60 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:11.502224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:11.503754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d08712-2668-4981-ab4c-e0a0fae2e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:11.504849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08712-2668-4981-ab4c-e0a0fae2e1ec None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.505416 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08712-2668-4981-ab4c-e0a0fae2e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.505835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08712-2668-4981-ab4c-e0a0fae2e1ec None admin] PATH_INFO: `/v3/users/a88e097db1684db59fb7003cf9945ef2` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.526586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d08712-2668-4981-ab4c-e0a0fae2e1ec None admin] RBAC: Authorizing `identity:get_user(user_id=a88e097db1684db59fb7003cf9945ef2)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:11.528140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d08712-2668-4981-ab4c-e0a0fae2e1ec None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:11.530079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b34cb8-ed3b-4a53-8aaa-0a474a50dd89 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:11.530293 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 85/169] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:11 2022] GET /identity/v3/users/a88e097db1684db59fb7003cf9945ef2 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:11.534088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6edfe-a2fd-4813-a3b0-be242fd210e5 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.534343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6edfe-a2fd-4813-a3b0-be242fd210e5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.534906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6edfe-a2fd-4813-a3b0-be242fd210e5 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.536053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 86/170] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:11.536839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6edfe-a2fd-4813-a3b0-be242fd210e5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:11.569856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11af4-1aec-473e-b91d-2972166837a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:11.570488 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11af4-1aec-473e-b91d-2972166837a1 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.570992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11af4-1aec-473e-b91d-2972166837a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.571337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11af4-1aec-473e-b91d-2972166837a1 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.571915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11af4-1aec-473e-b91d-2972166837a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:11.573405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11af4-1aec-473e-b91d-2972166837a1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:11.596328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 85/171] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:11 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:11.597163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11af4-1aec-473e-b91d-2972166837a1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:11.664339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6edfe-a2fd-4813-a3b0-be242fd210e5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:11.703161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:11.715470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c580518-71da-4516-aa31-17ad8d960814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:11.716459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580518-71da-4516-aa31-17ad8d960814 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.716792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580518-71da-4516-aa31-17ad8d960814 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.717226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580518-71da-4516-aa31-17ad8d960814 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.736244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c580518-71da-4516-aa31-17ad8d960814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-9c580518-71da-4516-aa31-17ad8d960814 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:11.745121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:11.746128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:11.751290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:11.752019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11af4-1aec-473e-b91d-2972166837a1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:11.752101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 87/172] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:29:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:11.752101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7cbd9-c6b0-4853-b629-ca3282624ab4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.752101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7cbd9-c6b0-4853-b629-ca3282624ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.752101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7cbd9-c6b0-4853-b629-ca3282624ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.769450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0ea7cbd9-c6b0-4853-b629-ca3282624ab4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:11.770817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0ea7cbd9-c6b0-4853-b629-ca3282624ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:11.786689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:11.797533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166665ae-fa28-448a-ac5d-691014639a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:11.797737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166665ae-fa28-448a-ac5d-691014639a9f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.797982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166665ae-fa28-448a-ac5d-691014639a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.798414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166665ae-fa28-448a-ac5d-691014639a9f None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.800958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166665ae-fa28-448a-ac5d-691014639a9f None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:11.802580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166665ae-fa28-448a-ac5d-691014639a9f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:11.804920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 86/173] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:11 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:11.805505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166665ae-fa28-448a-ac5d-691014639a9f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:11.866674 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 88/174] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:11.868067 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7cbd9-c6b0-4853-b629-ca3282624ab4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:11.933963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166665ae-fa28-448a-ac5d-691014639a9f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:11.990009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898560-9eee-4c37-bf71-9da1c341b7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:11.990625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898560-9eee-4c37-bf71-9da1c341b7ac None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:11.990898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898560-9eee-4c37-bf71-9da1c341b7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:11.991188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898560-9eee-4c37-bf71-9da1c341b7ac None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:11.991902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db898560-9eee-4c37-bf71-9da1c341b7ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:11.992296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db898560-9eee-4c37-bf71-9da1c341b7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:11.993717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db898560-9eee-4c37-bf71-9da1c341b7ac None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:12.004508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 87/175] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:12.011306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7cbd9-c6b0-4853-b629-ca3282624ab4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:12.012243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898560-9eee-4c37-bf71-9da1c341b7ac None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:12.037774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:12.052998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f6eb6-fe51-4f1e-8a17-8a610c5ad79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:12.053915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6eb6-fe51-4f1e-8a17-8a610c5ad79a None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:12.054020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6eb6-fe51-4f1e-8a17-8a610c5ad79a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:12.054250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6eb6-fe51-4f1e-8a17-8a610c5ad79a None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/users/a88e097db1684db59fb7003cf9945ef2/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:12.056804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f6eb6-fe51-4f1e-8a17-8a610c5ad79a None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a370bf40ca4f53b61878f62d5d2333, user_id=a88e097db1684db59fb7003cf9945ef2, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:12.058389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f6eb6-fe51-4f1e-8a17-8a610c5ad79a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:12.077096 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 89/176] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:11 2022] PUT /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/users/a88e097db1684db59fb7003cf9945ef2/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:12.095828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:12.159411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898560-9eee-4c37-bf71-9da1c341b7ac None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:12.204215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aeae6-87d9-4a86-b1bb-f849d49e4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:12.205261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aeae6-87d9-4a86-b1bb-f849d49e4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:12.205747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aeae6-87d9-4a86-b1bb-f849d49e4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:12.206242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aeae6-87d9-4a86-b1bb-f849d49e4fa2 None admin] PATH_INFO: `/v3/users/262683760c094321bb41e95bbd17304b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:12.207854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aeae6-87d9-4a86-b1bb-f849d49e4fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=262683760c094321bb41e95bbd17304b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:12.209615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aeae6-87d9-4a86-b1bb-f849d49e4fa2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:12.212509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 88/177] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:12 2022] GET /identity/v3/users/262683760c094321bb41e95bbd17304b => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:12.224128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f6eb6-fe51-4f1e-8a17-8a610c5ad79a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:12.277551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aeae6-87d9-4a86-b1bb-f849d49e4fa2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:12.372262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f6eb6-fe51-4f1e-8a17-8a610c5ad79a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:12.433522 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cd940-90cc-4f1f-b1d5-315caa49898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:12.434504 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cd940-90cc-4f1f-b1d5-315caa49898b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:12.435035 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cd940-90cc-4f1f-b1d5-315caa49898b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:12.435519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cd940-90cc-4f1f-b1d5-315caa49898b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:12.438656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aeae6-87d9-4a86-b1bb-f849d49e4fa2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:12.489056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:12.511555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ea748-d8d4-4886-9992-b347dc8a96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:12.512213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ea748-d8d4-4886-9992-b347dc8a96c9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:12.512471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ea748-d8d4-4886-9992-b347dc8a96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:12.512745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ea748-d8d4-4886-9992-b347dc8a96c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:12.528998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:12.534464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ea748-d8d4-4886-9992-b347dc8a96c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c58ea748-d8d4-4886-9992-b347dc8a96c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:12.540448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:12.541972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:12.543377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 89/178] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:29:12.551791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ea748-d8d4-4886-9992-b347dc8a96c9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:12.571473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cd940-90cc-4f1f-b1d5-315caa49898b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:12.575390 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cd940-90cc-4f1f-b1d5-315caa49898b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:12.722409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 90/179] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:12.734358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cd940-90cc-4f1f-b1d5-315caa49898b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:12.808693 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ea748-d8d4-4886-9992-b347dc8a96c9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:12.847304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:12.877727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cd940-90cc-4f1f-b1d5-315caa49898b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:12.904055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdf3e-8b10-4f02-b46d-26652dce0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:12.904684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdf3e-8b10-4f02-b46d-26652dce0b92 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:12.904962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdf3e-8b10-4f02-b46d-26652dce0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:12.905226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdf3e-8b10-4f02-b46d-26652dce0b92 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:12.905896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bdf3e-8b10-4f02-b46d-26652dce0b92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:12.906193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bdf3e-8b10-4f02-b46d-26652dce0b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:12.907622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bdf3e-8b10-4f02-b46d-26652dce0b92 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:12.927781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 90/180] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:12.933910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdf3e-8b10-4f02-b46d-26652dce0b92 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:12.962352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cf1c5-a194-42bb-8d91-698fc163c000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:12.963093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cf1c5-a194-42bb-8d91-698fc163c000 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:12.963373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cf1c5-a194-42bb-8d91-698fc163c000 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:12.963647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cf1c5-a194-42bb-8d91-698fc163c000 None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:12.969480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cf1c5-a194-42bb-8d91-698fc163c000 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:12.971020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cf1c5-a194-42bb-8d91-698fc163c000 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:12.972875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 91/181] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:12 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:12.984242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cf1c5-a194-42bb-8d91-698fc163c000 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:13.016369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:13.085918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdf3e-8b10-4f02-b46d-26652dce0b92 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:13.153143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9175d1d-2c41-44b7-99b1-a2968b35a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:13.154140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9175d1d-2c41-44b7-99b1-a2968b35a1af None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:13.154432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9175d1d-2c41-44b7-99b1-a2968b35a1af None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:13.154667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9175d1d-2c41-44b7-99b1-a2968b35a1af None admin] PATH_INFO: `/v3/users/262683760c094321bb41e95bbd17304b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:13.159859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9175d1d-2c41-44b7-99b1-a2968b35a1af None admin] RBAC: Authorizing `identity:get_user(user_id=262683760c094321bb41e95bbd17304b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:13.161372 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9175d1d-2c41-44b7-99b1-a2968b35a1af None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:13.163134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 91/182] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:12 2022] GET /identity/v3/users/262683760c094321bb41e95bbd17304b => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:13.174282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cf1c5-a194-42bb-8d91-698fc163c000 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:13.175995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9175d1d-2c41-44b7-99b1-a2968b35a1af None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:13.212747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3bffd-da36-459f-a773-06a224017256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:13.213422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3bffd-da36-459f-a773-06a224017256 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:13.213699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3bffd-da36-459f-a773-06a224017256 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:13.213954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3bffd-da36-459f-a773-06a224017256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:13.214727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3bffd-da36-459f-a773-06a224017256 None admin] RBAC: Adding query filter params (role.id=53001a60e154408cbe7ea6ad0f2d7e0f, scope.project.id=a6a370bf40ca4f53b61878f62d5d2333, user.id=262683760c094321bb41e95bbd17304b) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:13.215055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3bffd-da36-459f-a773-06a224017256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:13.216546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3bffd-da36-459f-a773-06a224017256 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:13.223491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 92/183] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:12 2022] GET /identity/v3/role_assignments?user.id=262683760c094321bb41e95bbd17304b&scope.project.id=a6a370bf40ca4f53b61878f62d5d2333&role.id=53001a60e154408cbe7ea6ad0f2d7e0f => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:13.375519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9175d1d-2c41-44b7-99b1-a2968b35a1af None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:13.400920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:13.426026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c2bfa-888a-479b-b86e-cec78e3b9814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:13.426646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c2bfa-888a-479b-b86e-cec78e3b9814 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:13.426917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c2bfa-888a-479b-b86e-cec78e3b9814 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:13.427211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c2bfa-888a-479b-b86e-cec78e3b9814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:13.504536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c2bfa-888a-479b-b86e-cec78e3b9814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:13.505956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c2bfa-888a-479b-b86e-cec78e3b9814 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:13.642991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 92/184] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:13.649668 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3bffd-da36-459f-a773-06a224017256 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:13.669278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:13.762970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3bffd-da36-459f-a773-06a224017256 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:13.798611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737891f-bd37-4a2c-8770-694ba26c88bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:13.799286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737891f-bd37-4a2c-8770-694ba26c88bc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:13.799553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737891f-bd37-4a2c-8770-694ba26c88bc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:13.799830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737891f-bd37-4a2c-8770-694ba26c88bc None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:13.800932 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737891f-bd37-4a2c-8770-694ba26c88bc None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:13.802374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737891f-bd37-4a2c-8770-694ba26c88bc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:13.804655 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 93/185] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:13 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:13.810527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c2bfa-888a-479b-b86e-cec78e3b9814 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:13.837266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:13.980656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c2bfa-888a-479b-b86e-cec78e3b9814 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:14.037523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163435a1-6b45-474e-93d8-f98741d2edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:14.039047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163435a1-6b45-474e-93d8-f98741d2edc6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:14.040075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163435a1-6b45-474e-93d8-f98741d2edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:14.040817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163435a1-6b45-474e-93d8-f98741d2edc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:14.042507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163435a1-6b45-474e-93d8-f98741d2edc6 None admin] RBAC: Adding query filter params (role.id=581091dd624142d3aad6710d1eb0affa, scope.project.id=a6a370bf40ca4f53b61878f62d5d2333, user.id=262683760c094321bb41e95bbd17304b) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:14.043355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163435a1-6b45-474e-93d8-f98741d2edc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:14.046426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163435a1-6b45-474e-93d8-f98741d2edc6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:14.058093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 93/186] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:13 2022] GET /identity/v3/role_assignments?user.id=262683760c094321bb41e95bbd17304b&scope.project.id=a6a370bf40ca4f53b61878f62d5d2333&role.id=581091dd624142d3aad6710d1eb0affa => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:14.504733 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d162a8-32d2-4475-acfc-8efe9566b0bb None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:14.505202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d162a8-32d2-4475-acfc-8efe9566b0bb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:14.505626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d162a8-32d2-4475-acfc-8efe9566b0bb None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:14.508005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 94/187] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:14.516237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cabbf-c1bc-426a-a289-ff0fcd3c4252 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:14.516714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cabbf-c1bc-426a-a289-ff0fcd3c4252 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:14.517176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cabbf-c1bc-426a-a289-ff0fcd3c4252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:14.547150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f03cabbf-c1bc-426a-a289-ff0fcd3c4252 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:14.549115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f03cabbf-c1bc-426a-a289-ff0fcd3c4252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:14.649076 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 94/188] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:14.694661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed463d-5a0c-4482-9d45-bb91dff71cd6 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:14.695317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed463d-5a0c-4482-9d45-bb91dff71cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:14.695317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed463d-5a0c-4482-9d45-bb91dff71cd6 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:14.696786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 95/189] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:14.703514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e143c0f-db18-4198-bc7a-e4b968b6e693 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:14.704520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e143c0f-db18-4198-bc7a-e4b968b6e693 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:14.704520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e143c0f-db18-4198-bc7a-e4b968b6e693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:14.723202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7e143c0f-db18-4198-bc7a-e4b968b6e693 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:14.724379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7e143c0f-db18-4198-bc7a-e4b968b6e693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:14.732357 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:14.808884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 95/190] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:14.952798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed463d-5a0c-4482-9d45-bb91dff71cd6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.020698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494835bd-5874-4d5b-bf00-e5dcff79d762 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.021193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494835bd-5874-4d5b-bf00-e5dcff79d762 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.021640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494835bd-5874-4d5b-bf00-e5dcff79d762 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.028486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 96/191] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:15.030248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd61db3-439b-4c5f-b786-c51905c3cf3e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.030528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd61db3-439b-4c5f-b786-c51905c3cf3e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.030795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd61db3-439b-4c5f-b786-c51905c3cf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.047609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:15.049678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bbd61db3-439b-4c5f-b786-c51905c3cf3e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:15.050910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bbd61db3-439b-4c5f-b786-c51905c3cf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:15.074545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed463d-5a0c-4482-9d45-bb91dff71cd6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:15.126347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 97/192] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:29:15.127325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd61db3-439b-4c5f-b786-c51905c3cf3e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.127541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6492a-b3fb-495b-aeb8-7d1d63da4e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:15.128142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6492a-b3fb-495b-aeb8-7d1d63da4e50 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.128411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6492a-b3fb-495b-aeb8-7d1d63da4e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.128673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6492a-b3fb-495b-aeb8-7d1d63da4e50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.144524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6492a-b3fb-495b-aeb8-7d1d63da4e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-24d6492a-b3fb-495b-aeb8-7d1d63da4e50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:15.155023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:15.155933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:15.156738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:15.157323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 96/193] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:15.162732 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6492a-b3fb-495b-aeb8-7d1d63da4e50 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.228213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:15.280501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd61db3-439b-4c5f-b786-c51905c3cf3e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:15.281785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6492a-b3fb-495b-aeb8-7d1d63da4e50 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:15.334864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44ab5d-e796-4edc-85ea-18957da65850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:15.335120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909e07f-239f-4413-ae32-ee75c7521db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:15.335985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44ab5d-e796-4edc-85ea-18957da65850 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.336227 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909e07f-239f-4413-ae32-ee75c7521db0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.336407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44ab5d-e796-4edc-85ea-18957da65850 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.336645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909e07f-239f-4413-ae32-ee75c7521db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.336751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44ab5d-e796-4edc-85ea-18957da65850 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.337103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909e07f-239f-4413-ae32-ee75c7521db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.338265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909e07f-239f-4413-ae32-ee75c7521db0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:15.338371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44ab5d-e796-4edc-85ea-18957da65850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:15.338794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909e07f-239f-4413-ae32-ee75c7521db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:15.340843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44ab5d-e796-4edc-85ea-18957da65850 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:15.341343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909e07f-239f-4413-ae32-ee75c7521db0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:15.345011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 98/194] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:15.352261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44ab5d-e796-4edc-85ea-18957da65850 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.355225 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 97/195] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:15.361154 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909e07f-239f-4413-ae32-ee75c7521db0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.365886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:15.476923 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909e07f-239f-4413-ae32-ee75c7521db0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:15.482066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44ab5d-e796-4edc-85ea-18957da65850 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:15.517076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b78a-face-426e-a5f8-02630a32f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:15.517735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b78a-face-426e-a5f8-02630a32f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.517841 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cacb0-ce1a-4002-84ab-ec92c824b42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:15.518004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b78a-face-426e-a5f8-02630a32f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.518265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b78a-face-426e-a5f8-02630a32f3c2 None admin] PATH_INFO: `/v3/users/0f23c89010664016838034f2c4118182` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.518360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cacb0-ce1a-4002-84ab-ec92c824b42d None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.518634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cacb0-ce1a-4002-84ab-ec92c824b42d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.518903 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cacb0-ce1a-4002-84ab-ec92c824b42d None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.519589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cacb0-ce1a-4002-84ab-ec92c824b42d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:15.521080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cacb0-ce1a-4002-84ab-ec92c824b42d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:15.533410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3b78a-face-426e-a5f8-02630a32f3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=0f23c89010664016838034f2c4118182)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:15.534084 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:15.534863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3b78a-face-426e-a5f8-02630a32f3c2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:15.536829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 98/196] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:15 2022] GET /identity/v3/users/0f23c89010664016838034f2c4118182 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:15.537707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b78a-face-426e-a5f8-02630a32f3c2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.567242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 99/197] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:15 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:29:15.568621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cacb0-ce1a-4002-84ab-ec92c824b42d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.614675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:15.676627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b78a-face-426e-a5f8-02630a32f3c2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:15.706888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cacb0-ce1a-4002-84ab-ec92c824b42d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:15.721968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a766760-03cb-4456-bdde-a89945516abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:15.723299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a766760-03cb-4456-bdde-a89945516abf None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.723707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a766760-03cb-4456-bdde-a89945516abf None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.724122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a766760-03cb-4456-bdde-a89945516abf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.737279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a766760-03cb-4456-bdde-a89945516abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-8a766760-03cb-4456-bdde-a89945516abf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:15.742842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:15.743903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:15.744863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:15.746939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 99/198] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:15.749129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cebbf2-22f3-48b7-a74a-d227fe855477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:15.749808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cebbf2-22f3-48b7-a74a-d227fe855477 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.750072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cebbf2-22f3-48b7-a74a-d227fe855477 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.750341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cebbf2-22f3-48b7-a74a-d227fe855477 None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.751620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cebbf2-22f3-48b7-a74a-d227fe855477 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:15.753055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a766760-03cb-4456-bdde-a89945516abf None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.753234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cebbf2-22f3-48b7-a74a-d227fe855477 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:15.755022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 100/199] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:15 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:15.761709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cebbf2-22f3-48b7-a74a-d227fe855477 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.845059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:15.878030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a766760-03cb-4456-bdde-a89945516abf None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:15.892758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cebbf2-22f3-48b7-a74a-d227fe855477 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:15.911490 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:15.932082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b9ae0-63aa-4901-8883-de36a68c3f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:15.932802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b9ae0-63aa-4901-8883-de36a68c3f68 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.933101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b9ae0-63aa-4901-8883-de36a68c3f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.933460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b9ae0-63aa-4901-8883-de36a68c3f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.934009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b9ae0-63aa-4901-8883-de36a68c3f68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:15.934304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b9ae0-63aa-4901-8883-de36a68c3f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:15.936525 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b9ae0-63aa-4901-8883-de36a68c3f68 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:15.946824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 100/200] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:15.953217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b9ae0-63aa-4901-8883-de36a68c3f68 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:15.959745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb1a30-afa2-4816-8e95-e86e0bd9577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:15.961330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb1a30-afa2-4816-8e95-e86e0bd9577a None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:15.962024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb1a30-afa2-4816-8e95-e86e0bd9577a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:15.962687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb1a30-afa2-4816-8e95-e86e0bd9577a None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/users/0f23c89010664016838034f2c4118182/roles/cdea924879894f8aa246be169f37b2b9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:15.969580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb1a30-afa2-4816-8e95-e86e0bd9577a None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a370bf40ca4f53b61878f62d5d2333, user_id=0f23c89010664016838034f2c4118182, role_id=cdea924879894f8aa246be169f37b2b9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:15.972486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb1a30-afa2-4816-8e95-e86e0bd9577a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:15.997234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 101/201] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:15 2022] PUT /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/users/0f23c89010664016838034f2c4118182/roles/cdea924879894f8aa246be169f37b2b9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:16.087611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b9ae0-63aa-4901-8883-de36a68c3f68 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:16.129655 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e7ba2-601a-4b0a-858a-0d325c335c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:16.130659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7ba2-601a-4b0a-858a-0d325c335c48 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:16.131147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7ba2-601a-4b0a-858a-0d325c335c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:16.131557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7ba2-601a-4b0a-858a-0d325c335c48 None admin] PATH_INFO: `/v3/users/a88e097db1684db59fb7003cf9945ef2` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:16.133108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e7ba2-601a-4b0a-858a-0d325c335c48 None admin] RBAC: Authorizing `identity:get_user(user_id=a88e097db1684db59fb7003cf9945ef2)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:16.134767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e7ba2-601a-4b0a-858a-0d325c335c48 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:16.137002 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 101/202] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:15 2022] GET /identity/v3/users/a88e097db1684db59fb7003cf9945ef2 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:16.143139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb1a30-afa2-4816-8e95-e86e0bd9577a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:16.261520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb1a30-afa2-4816-8e95-e86e0bd9577a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:16.288481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:16.301953 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b863eb-b0c1-4ab3-9c8a-015a648cfb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:16.302804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b863eb-b0c1-4ab3-9c8a-015a648cfb0f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:16.303282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b863eb-b0c1-4ab3-9c8a-015a648cfb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:16.303731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b863eb-b0c1-4ab3-9c8a-015a648cfb0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:16.378396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b863eb-b0c1-4ab3-9c8a-015a648cfb0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:16.380760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b863eb-b0c1-4ab3-9c8a-015a648cfb0f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:16.518767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 102/203] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:16.524738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e7ba2-601a-4b0a-858a-0d325c335c48 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:16.585456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:16.636437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e7ba2-601a-4b0a-858a-0d325c335c48 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:16.679530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84eb0ed-2d2e-4f43-891c-01243215cdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:16.679530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eb0ed-2d2e-4f43-891c-01243215cdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:16.679530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eb0ed-2d2e-4f43-891c-01243215cdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:16.679530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eb0ed-2d2e-4f43-891c-01243215cdf5 None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:16.680724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eb0ed-2d2e-4f43-891c-01243215cdf5 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:16.682345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eb0ed-2d2e-4f43-891c-01243215cdf5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:16.684577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 102/204] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:16 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:16.690674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b863eb-b0c1-4ab3-9c8a-015a648cfb0f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:16.717141 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:16.801115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b863eb-b0c1-4ab3-9c8a-015a648cfb0f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:16.841907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2a64e-fa23-4100-99db-44bdb18f0b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:16.842513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2a64e-fa23-4100-99db-44bdb18f0b34 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:16.842783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2a64e-fa23-4100-99db-44bdb18f0b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:16.843088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2a64e-fa23-4100-99db-44bdb18f0b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:16.843813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2a64e-fa23-4100-99db-44bdb18f0b34 None admin] RBAC: Adding query filter params (role.id=28346cbeb7e94e25b52f586669c5beaa, scope.project.id=a6a370bf40ca4f53b61878f62d5d2333, user.id=a88e097db1684db59fb7003cf9945ef2) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:16.844112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2a64e-fa23-4100-99db-44bdb18f0b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:16.845565 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2a64e-fa23-4100-99db-44bdb18f0b34 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:16.852085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 103/205] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:16 2022] GET /identity/v3/role_assignments?user.id=a88e097db1684db59fb7003cf9945ef2&scope.project.id=a6a370bf40ca4f53b61878f62d5d2333&role.id=28346cbeb7e94e25b52f586669c5beaa => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:17.984890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea45be0-e917-423d-b612-2e7a23302c1d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:17.985446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea45be0-e917-423d-b612-2e7a23302c1d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:17.985446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea45be0-e917-423d-b612-2e7a23302c1d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:17.986975 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 103/206] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:17.992459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218916a0-5d12-42d3-b778-a0daaf69cf21 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:17.992902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218916a0-5d12-42d3-b778-a0daaf69cf21 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:17.992996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218916a0-5d12-42d3-b778-a0daaf69cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.011648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-218916a0-5d12-42d3-b778-a0daaf69cf21 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:18.012842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-218916a0-5d12-42d3-b778-a0daaf69cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:18.071375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943e64f-cce3-4f79-9d04-137f3b2ebcd7 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:18.071660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943e64f-cce3-4f79-9d04-137f3b2ebcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:18.071936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943e64f-cce3-4f79-9d04-137f3b2ebcd7 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.073477 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 104/207] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:29:18.078578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbfc34-c565-4fc4-9cfb-94a7ae0b474e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:18.078860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbfc34-c565-4fc4-9cfb-94a7ae0b474e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:18.079160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbfc34-c565-4fc4-9cfb-94a7ae0b474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.089670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 104/208] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:18.098299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e7fbfc34-c565-4fc4-9cfb-94a7ae0b474e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:18.099544 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e7fbfc34-c565-4fc4-9cfb-94a7ae0b474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:18.170591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 105/209] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:29:18.346302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72f26c-691e-464e-a276-8292ab9d2485 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:18.347244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72f26c-691e-464e-a276-8292ab9d2485 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:18.347244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72f26c-691e-464e-a276-8292ab9d2485 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.348333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 105/210] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:18.353914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b2ee-be7b-4313-965b-7e3878b2888d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:18.354282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b2ee-be7b-4313-965b-7e3878b2888d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:18.354599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b2ee-be7b-4313-965b-7e3878b2888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.358264 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72f26c-691e-464e-a276-8292ab9d2485 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:18.386796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:18.387345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6cd2b2ee-be7b-4313-965b-7e3878b2888d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:18.389736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6cd2b2ee-be7b-4313-965b-7e3878b2888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:18.457589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:18.481706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 106/211] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:18.482246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72f26c-691e-464e-a276-8292ab9d2485 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:18.482557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b2ee-be7b-4313-965b-7e3878b2888d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:18.521681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ff003-a45f-435c-a89f-689362c83816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:18.522303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ff003-a45f-435c-a89f-689362c83816 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:18.522582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ff003-a45f-435c-a89f-689362c83816 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:18.523243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ff003-a45f-435c-a89f-689362c83816 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.534690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ff003-a45f-435c-a89f-689362c83816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-da3ff003-a45f-435c-a89f-689362c83816 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:18.539812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:18.540988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:18.541928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 106/212] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:29:18.546735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ff003-a45f-435c-a89f-689362c83816 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:18.606457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b2ee-be7b-4313-965b-7e3878b2888d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:18.632027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:18.655115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ff003-a45f-435c-a89f-689362c83816 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:18.658793 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0789357-b4be-4e38-ba8d-f7d56455a375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:18.659472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0789357-b4be-4e38-ba8d-f7d56455a375 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:18.659749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0789357-b4be-4e38-ba8d-f7d56455a375 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:18.660020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0789357-b4be-4e38-ba8d-f7d56455a375 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.661122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0789357-b4be-4e38-ba8d-f7d56455a375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:18.662580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0789357-b4be-4e38-ba8d-f7d56455a375 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:18.664454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 107/213] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:18.669717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0789357-b4be-4e38-ba8d-f7d56455a375 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:18.690854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0cc97-88f6-41d9-a4c7-ccd29b55c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:18.691482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cc97-88f6-41d9-a4c7-ccd29b55c4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:18.691755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cc97-88f6-41d9-a4c7-ccd29b55c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:18.692019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cc97-88f6-41d9-a4c7-ccd29b55c4f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.693118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0cc97-88f6-41d9-a4c7-ccd29b55c4f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:18.693411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0cc97-88f6-41d9-a4c7-ccd29b55c4f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:18.695094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0cc97-88f6-41d9-a4c7-ccd29b55c4f6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:18.709602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 107/214] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:18.710672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0cc97-88f6-41d9-a4c7-ccd29b55c4f6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:18.722021 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:18.783190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0789357-b4be-4e38-ba8d-f7d56455a375 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:18.818065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb96f2-62e2-49f5-abdb-c6228ba57af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:18.818662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb96f2-62e2-49f5-abdb-c6228ba57af6 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:18.818980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb96f2-62e2-49f5-abdb-c6228ba57af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:18.819247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb96f2-62e2-49f5-abdb-c6228ba57af6 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.820107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb96f2-62e2-49f5-abdb-c6228ba57af6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:18.821881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb96f2-62e2-49f5-abdb-c6228ba57af6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:18.828986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0cc97-88f6-41d9-a4c7-ccd29b55c4f6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:18.845027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 108/215] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:18 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:29:18.845991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb96f2-62e2-49f5-abdb-c6228ba57af6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:18.868234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49d7f8-33f3-4b26-85dc-da178c5ad66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:18.869011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49d7f8-33f3-4b26-85dc-da178c5ad66f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:18.869378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49d7f8-33f3-4b26-85dc-da178c5ad66f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:18.870018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49d7f8-33f3-4b26-85dc-da178c5ad66f None admin] PATH_INFO: `/v3/users/4596919533344f9eb9f5333be1332875` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:18.883189 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:18.887386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49d7f8-33f3-4b26-85dc-da178c5ad66f None admin] RBAC: Authorizing `identity:get_user(user_id=4596919533344f9eb9f5333be1332875)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:18.889386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49d7f8-33f3-4b26-85dc-da178c5ad66f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:18.896373 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 108/216] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:18 2022] GET /identity/v3/users/4596919533344f9eb9f5333be1332875 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:18.897694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49d7f8-33f3-4b26-85dc-da178c5ad66f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:18.978036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb96f2-62e2-49f5-abdb-c6228ba57af6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:18.980966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:19.026758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751a9c7-b749-4369-9982-db5f48b6b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:19.027465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751a9c7-b749-4369-9982-db5f48b6b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:19.027724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751a9c7-b749-4369-9982-db5f48b6b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:19.028343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751a9c7-b749-4369-9982-db5f48b6b9f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:19.034752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49d7f8-33f3-4b26-85dc-da178c5ad66f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:19.043494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751a9c7-b749-4369-9982-db5f48b6b9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f751a9c7-b749-4369-9982-db5f48b6b9f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:19.048642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:19.049545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:19.050310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 109/217] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:19.056933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751a9c7-b749-4369-9982-db5f48b6b9f7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:19.078561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643a21-7b22-46c4-b00b-1be8459f4110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:19.079200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643a21-7b22-46c4-b00b-1be8459f4110 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:19.079471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643a21-7b22-46c4-b00b-1be8459f4110 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:19.079733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643a21-7b22-46c4-b00b-1be8459f4110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:19.080454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14643a21-7b22-46c4-b00b-1be8459f4110 None admin] RBAC: Adding query filter params (role.id=28346cbeb7e94e25b52f586669c5beaa, user.id=4596919533344f9eb9f5333be1332875, scope.system=all) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:19.080750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14643a21-7b22-46c4-b00b-1be8459f4110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:19.082219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14643a21-7b22-46c4-b00b-1be8459f4110 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:19.087949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 109/218] 10.222.0.46 () {56 vars in 1308 bytes} [Mon Oct 24 13:29:18 2022] GET /identity/v3/role_assignments?user.id=4596919533344f9eb9f5333be1332875&scope.system=all&role.id=28346cbeb7e94e25b52f586669c5beaa => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:19.189410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751a9c7-b749-4369-9982-db5f48b6b9f7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:19.234056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa9f84-0b54-4460-977d-2eaee145db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:19.241753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa9f84-0b54-4460-977d-2eaee145db18 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:19.241753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa9f84-0b54-4460-977d-2eaee145db18 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:19.241753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa9f84-0b54-4460-977d-2eaee145db18 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:19.241753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa9f84-0b54-4460-977d-2eaee145db18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:19.241753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa9f84-0b54-4460-977d-2eaee145db18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:19.241753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa9f84-0b54-4460-977d-2eaee145db18 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:19.248229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 110/219] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:19.254977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643a21-7b22-46c4-b00b-1be8459f4110 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:19.333324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:19.377120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643a21-7b22-46c4-b00b-1be8459f4110 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:19.415934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b0a3-b201-486f-9b28-4c379ca005af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:19.416582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b0a3-b201-486f-9b28-4c379ca005af None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:19.416852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b0a3-b201-486f-9b28-4c379ca005af None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:19.417180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b0a3-b201-486f-9b28-4c379ca005af None admin] PATH_INFO: `/v3/users/0f23c89010664016838034f2c4118182` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:19.418326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799b0a3-b201-486f-9b28-4c379ca005af None admin] RBAC: Authorizing `identity:get_user(user_id=0f23c89010664016838034f2c4118182)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:19.420339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799b0a3-b201-486f-9b28-4c379ca005af None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:19.422420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 110/220] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:19 2022] GET /identity/v3/users/0f23c89010664016838034f2c4118182 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:19.428142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa9f84-0b54-4460-977d-2eaee145db18 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:19.463399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:19.545942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa9f84-0b54-4460-977d-2eaee145db18 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:19.581818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645106c-3afc-4011-92b5-a677ef59094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:19.582446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645106c-3afc-4011-92b5-a677ef59094a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:19.582717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645106c-3afc-4011-92b5-a677ef59094a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:19.582997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645106c-3afc-4011-92b5-a677ef59094a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:19.669442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645106c-3afc-4011-92b5-a677ef59094a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:19.670939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645106c-3afc-4011-92b5-a677ef59094a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:19.700394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:19.786015 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 111/221] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:19.792362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b0a3-b201-486f-9b28-4c379ca005af None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:20.076837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b0a3-b201-486f-9b28-4c379ca005af None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:20.168661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:20.175794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4dee8-e4bd-49a4-9b0a-1427c4898892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:20.176438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4dee8-e4bd-49a4-9b0a-1427c4898892 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:20.176716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4dee8-e4bd-49a4-9b0a-1427c4898892 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:20.176985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4dee8-e4bd-49a4-9b0a-1427c4898892 None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:20.178646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4dee8-e4bd-49a4-9b0a-1427c4898892 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:20.184508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4dee8-e4bd-49a4-9b0a-1427c4898892 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:20.190525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 111/222] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:19 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:20.200894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645106c-3afc-4011-92b5-a677ef59094a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:20.371136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645106c-3afc-4011-92b5-a677ef59094a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:20.414435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:20.423957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c9d87-54d8-405d-96d2-88ef06bcec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:20.424997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c9d87-54d8-405d-96d2-88ef06bcec7e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:20.425460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c9d87-54d8-405d-96d2-88ef06bcec7e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:20.425934 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c9d87-54d8-405d-96d2-88ef06bcec7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:20.426856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c9d87-54d8-405d-96d2-88ef06bcec7e None admin] RBAC: Adding query filter params (role.id=cdea924879894f8aa246be169f37b2b9, scope.project.id=a6a370bf40ca4f53b61878f62d5d2333, user.id=0f23c89010664016838034f2c4118182) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:20.427516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c9d87-54d8-405d-96d2-88ef06bcec7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:20.429292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c9d87-54d8-405d-96d2-88ef06bcec7e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:20.436539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 112/223] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:20 2022] GET /identity/v3/role_assignments?user.id=0f23c89010664016838034f2c4118182&scope.project.id=a6a370bf40ca4f53b61878f62d5d2333&role.id=cdea924879894f8aa246be169f37b2b9 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:21.420619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38eb5-5012-4671-8f6e-87af0bdaf16a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:21.421146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38eb5-5012-4671-8f6e-87af0bdaf16a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:21.421219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38eb5-5012-4671-8f6e-87af0bdaf16a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:21.422722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 112/224] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:21.428344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81cd38-c25d-4c4e-a99e-95274a226383 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:21.429731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81cd38-c25d-4c4e-a99e-95274a226383 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:21.429731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81cd38-c25d-4c4e-a99e-95274a226383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:21.449406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0c81cd38-c25d-4c4e-a99e-95274a226383 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:21.450653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0c81cd38-c25d-4c4e-a99e-95274a226383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:21.518009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a643fe-af47-437c-b35a-acf91ee5a157 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:21.518290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a643fe-af47-437c-b35a-acf91ee5a157 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:21.518581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a643fe-af47-437c-b35a-acf91ee5a157 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:21.519988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 113/225] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:29:21.526151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c21a9d-7d26-47d7-99bc-c155fd0efee8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:21.526528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c21a9d-7d26-47d7-99bc-c155fd0efee8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:21.526801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c21a9d-7d26-47d7-99bc-c155fd0efee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:21.528249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 113/226] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:21.546457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b6c21a9d-7d26-47d7-99bc-c155fd0efee8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:21.547741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b6c21a9d-7d26-47d7-99bc-c155fd0efee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:21.572662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb361-c4c8-44fc-a090-ccbe5ada2926 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:21.573023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb361-c4c8-44fc-a090-ccbe5ada2926 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:21.573211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb361-c4c8-44fc-a090-ccbe5ada2926 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:21.574573 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 114/227] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:29:21.579865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5953-8f2a-4949-93e6-237a659b3253 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:21.580150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5953-8f2a-4949-93e6-237a659b3253 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:21.580419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5953-8f2a-4949-93e6-237a659b3253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:21.598344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4e9b5953-8f2a-4949-93e6-237a659b3253 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:21.599561 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4e9b5953-8f2a-4949-93e6-237a659b3253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:21.621365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 114/228] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:29:21.671451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 115/229] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:29:21.792463 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c21a9d-7d26-47d7-99bc-c155fd0efee8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:21.896214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b5953-8f2a-4949-93e6-237a659b3253 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:21.897405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c21a9d-7d26-47d7-99bc-c155fd0efee8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:21.930093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:21.938360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb859ef-664f-4cdc-b345-05f3200f88b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:21.939026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb859ef-664f-4cdc-b345-05f3200f88b7 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:21.939297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb859ef-664f-4cdc-b345-05f3200f88b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:21.939558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb859ef-664f-4cdc-b345-05f3200f88b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:21.940671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb859ef-664f-4cdc-b345-05f3200f88b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:21.942124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb859ef-664f-4cdc-b345-05f3200f88b7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:21.943745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 115/230] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:21.944518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb859ef-664f-4cdc-b345-05f3200f88b7 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:21.955621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.006420 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b5953-8f2a-4949-93e6-237a659b3253 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:22.040865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c4f25-7ff1-43fc-9de5-fbc7269cce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:22.041503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c4f25-7ff1-43fc-9de5-fbc7269cce60 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:22.041775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c4f25-7ff1-43fc-9de5-fbc7269cce60 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:22.042040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c4f25-7ff1-43fc-9de5-fbc7269cce60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:22.045435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb859ef-664f-4cdc-b345-05f3200f88b7 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:22.052980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c4f25-7ff1-43fc-9de5-fbc7269cce60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-106c4f25-7ff1-43fc-9de5-fbc7269cce60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:22.058111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:22.059131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 116/231] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:29:22.060275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c4f25-7ff1-43fc-9de5-fbc7269cce60 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:22.081615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd0563-8fa7-41da-aa65-2fb26b689e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:22.082279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0563-8fa7-41da-aa65-2fb26b689e5c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:22.082550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0563-8fa7-41da-aa65-2fb26b689e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:22.082812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0563-8fa7-41da-aa65-2fb26b689e5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:22.093890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd0563-8fa7-41da-aa65-2fb26b689e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-00bd0563-8fa7-41da-aa65-2fb26b689e5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:22.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:22.099984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:22.100810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 116/232] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:22.101479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd0563-8fa7-41da-aa65-2fb26b689e5c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:22.159991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.167300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c4f25-7ff1-43fc-9de5-fbc7269cce60 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:22.186305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.205479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd0563-8fa7-41da-aa65-2fb26b689e5c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:22.213018 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b437522-be46-4710-96a2-0b573d5683a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:22.213727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b437522-be46-4710-96a2-0b573d5683a9 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:22.214002 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b437522-be46-4710-96a2-0b573d5683a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:22.214268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b437522-be46-4710-96a2-0b573d5683a9 None admin] PATH_INFO: `/v3/groups` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:22.214898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b437522-be46-4710-96a2-0b573d5683a9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:22.216383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b437522-be46-4710-96a2-0b573d5683a9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:22.235349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 117/233] 10.222.0.46 () {60 vars in 1134 bytes} [Mon Oct 24 13:29:22 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:22.236199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b437522-be46-4710-96a2-0b573d5683a9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:22.247862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0acc3-0013-4ea6-9b96-63320a6624f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:22.248941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0acc3-0013-4ea6-9b96-63320a6624f9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:22.249487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0acc3-0013-4ea6-9b96-63320a6624f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:22.249972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0acc3-0013-4ea6-9b96-63320a6624f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:22.250873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0acc3-0013-4ea6-9b96-63320a6624f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:22.251400 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0acc3-0013-4ea6-9b96-63320a6624f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:22.253856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0acc3-0013-4ea6-9b96-63320a6624f9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:22.264504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 117/234] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:22.270524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0acc3-0013-4ea6-9b96-63320a6624f9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:22.364192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b437522-be46-4710-96a2-0b573d5683a9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:22.405848 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0acc3-0013-4ea6-9b96-63320a6624f9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:22.407421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af370939-9485-4ae1-8cdb-53fa920056ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:22.408153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af370939-9485-4ae1-8cdb-53fa920056ea None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:22.408430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af370939-9485-4ae1-8cdb-53fa920056ea None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:22.408699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af370939-9485-4ae1-8cdb-53fa920056ea None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:22.409387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af370939-9485-4ae1-8cdb-53fa920056ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:22.409684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af370939-9485-4ae1-8cdb-53fa920056ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:22.411113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af370939-9485-4ae1-8cdb-53fa920056ea None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:22.420584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 118/235] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:22.426220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af370939-9485-4ae1-8cdb-53fa920056ea None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:22.427930 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.450868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21c13f-1a44-404b-b090-7ce5791cd104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:22.451729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21c13f-1a44-404b-b090-7ce5791cd104 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:22.451836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21c13f-1a44-404b-b090-7ce5791cd104 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:22.452986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21c13f-1a44-404b-b090-7ce5791cd104 None admin] PATH_INFO: `/v3/users/4596919533344f9eb9f5333be1332875` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:22.453989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21c13f-1a44-404b-b090-7ce5791cd104 None admin] RBAC: Authorizing `identity:get_user(user_id=4596919533344f9eb9f5333be1332875)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:22.455801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21c13f-1a44-404b-b090-7ce5791cd104 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:22.457126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 118/236] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:22 2022] GET /identity/v3/users/4596919533344f9eb9f5333be1332875 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:22.463327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21c13f-1a44-404b-b090-7ce5791cd104 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:22.468083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.550066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af370939-9485-4ae1-8cdb-53fa920056ea None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:22.571112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21c13f-1a44-404b-b090-7ce5791cd104 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:22.587804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664df64-c8bb-427a-b005-54889e8a4536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:22.588449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664df64-c8bb-427a-b005-54889e8a4536 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:22.588834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664df64-c8bb-427a-b005-54889e8a4536 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:22.589101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664df64-c8bb-427a-b005-54889e8a4536 None admin] PATH_INFO: `/v3/users/70720c09d32640ed85a38b581c0240bc` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:22.605040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664df64-c8bb-427a-b005-54889e8a4536 None admin] RBAC: Authorizing `identity:get_user(user_id=70720c09d32640ed85a38b581c0240bc)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:22.606529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664df64-c8bb-427a-b005-54889e8a4536 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:22.606650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc85873-32cd-444d-be2e-660a047e3d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:22.607327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85873-32cd-444d-be2e-660a047e3d98 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:22.607603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85873-32cd-444d-be2e-660a047e3d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:22.607870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85873-32cd-444d-be2e-660a047e3d98 None admin] PATH_INFO: `/v3/system/users/4596919533344f9eb9f5333be1332875/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:22.608461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 119/237] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:22 2022] GET /identity/v3/users/70720c09d32640ed85a38b581c0240bc => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:22.609302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc85873-32cd-444d-be2e-660a047e3d98 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4596919533344f9eb9f5333be1332875, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:22.610678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc85873-32cd-444d-be2e-660a047e3d98 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:22.614005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664df64-c8bb-427a-b005-54889e8a4536 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:22.621720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 119/238] 10.222.0.46 () {58 vars in 1334 bytes} [Mon Oct 24 13:29:22 2022] PUT /identity/v3/system/users/4596919533344f9eb9f5333be1332875/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:29:22.722335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.735193 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664df64-c8bb-427a-b005-54889e8a4536 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:22.775362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4bb4-ac5a-47f7-a3ad-a8a2ac1e41a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:22.775999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4bb4-ac5a-47f7-a3ad-a8a2ac1e41a7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:22.776267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4bb4-ac5a-47f7-a3ad-a8a2ac1e41a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:22.776529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4bb4-ac5a-47f7-a3ad-a8a2ac1e41a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:22.777261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4bb4-ac5a-47f7-a3ad-a8a2ac1e41a7 None admin] RBAC: Adding query filter params (role.id=cdea924879894f8aa246be169f37b2b9, user.id=70720c09d32640ed85a38b581c0240bc, scope.system=all) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:22.777563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4bb4-ac5a-47f7-a3ad-a8a2ac1e41a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:22.779411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4bb4-ac5a-47f7-a3ad-a8a2ac1e41a7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:22.785848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 120/239] 10.222.0.46 () {56 vars in 1308 bytes} [Mon Oct 24 13:29:22 2022] GET /identity/v3/role_assignments?user.id=70720c09d32640ed85a38b581c0240bc&scope.system=all&role.id=cdea924879894f8aa246be169f37b2b9 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:24.480054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02255073-18d7-42f8-acf3-0899edd6e56e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:24.480590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02255073-18d7-42f8-acf3-0899edd6e56e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:24.480590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02255073-18d7-42f8-acf3-0899edd6e56e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:24.482108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 120/240] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:24.487316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73086f-279b-46fd-b6d4-ca7a0e01d218 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:24.487724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73086f-279b-46fd-b6d4-ca7a0e01d218 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:24.487901 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73086f-279b-46fd-b6d4-ca7a0e01d218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:24.506174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ec73086f-279b-46fd-b6d4-ca7a0e01d218 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:24.507449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ec73086f-279b-46fd-b6d4-ca7a0e01d218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:24.579580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 121/241] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:24.804659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e61b7-4edd-427e-84b0-15f2d8adb89c None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:24.805055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e61b7-4edd-427e-84b0-15f2d8adb89c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:24.805168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e61b7-4edd-427e-84b0-15f2d8adb89c None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:24.806732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 121/242] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:24.811983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5193-686f-4644-8610-5ac0d02734b3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:24.812270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5193-686f-4644-8610-5ac0d02734b3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:24.812534 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5193-686f-4644-8610-5ac0d02734b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:24.832132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6c6a5193-686f-4644-8610-5ac0d02734b3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:24.833324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6c6a5193-686f-4644-8610-5ac0d02734b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:24.850370 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e61b7-4edd-427e-84b0-15f2d8adb89c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:24.910169 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:24.910511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 122/243] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:24.964713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e61b7-4edd-427e-84b0-15f2d8adb89c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:24.968900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03676e-21df-43b3-a784-de6ce7120c7e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:24.969189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03676e-21df-43b3-a784-de6ce7120c7e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:24.969443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03676e-21df-43b3-a784-de6ce7120c7e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:24.970969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 123/244] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:29:24.978622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa2060-392d-44d9-bf06-0bb9072a4c55 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:24.979140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa2060-392d-44d9-bf06-0bb9072a4c55 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:24.979578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa2060-392d-44d9-bf06-0bb9072a4c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:24.997920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fbfa2060-392d-44d9-bf06-0bb9072a4c55 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:24.999120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fbfa2060-392d-44d9-bf06-0bb9072a4c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:25.000120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7fa3-01f3-4b59-bab2-bb64cd3907e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:25.000938 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7fa3-01f3-4b59-bab2-bb64cd3907e6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:25.001380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7fa3-01f3-4b59-bab2-bb64cd3907e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:25.001783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7fa3-01f3-4b59-bab2-bb64cd3907e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:25.003024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd7fa3-01f3-4b59-bab2-bb64cd3907e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:25.004652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd7fa3-01f3-4b59-bab2-bb64cd3907e6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:25.006664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 122/245] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:25.009625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:25.012229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7fa3-01f3-4b59-bab2-bb64cd3907e6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:25.072985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 124/246] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:29:25.116531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7fa3-01f3-4b59-bab2-bb64cd3907e6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:25.135682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:25.155268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cd523-9c3f-49a5-b9c3-fd79a82311a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:25.155921 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cd523-9c3f-49a5-b9c3-fd79a82311a1 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:25.156197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cd523-9c3f-49a5-b9c3-fd79a82311a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:25.156459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cd523-9c3f-49a5-b9c3-fd79a82311a1 None admin] PATH_INFO: `/v3/groups` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:25.157090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cd523-9c3f-49a5-b9c3-fd79a82311a1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:25.158535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cd523-9c3f-49a5-b9c3-fd79a82311a1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:25.175752 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa2060-392d-44d9-bf06-0bb9072a4c55 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:25.177653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 123/247] 10.222.0.46 () {60 vars in 1134 bytes} [Mon Oct 24 13:29:25 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:29:25.289754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa2060-392d-44d9-bf06-0bb9072a4c55 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:25.327871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9350f-08e8-47ca-a4ae-cd5c9c539ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:25.328432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9350f-08e8-47ca-a4ae-cd5c9c539ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:25.328699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9350f-08e8-47ca-a4ae-cd5c9c539ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:25.328961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9350f-08e8-47ca-a4ae-cd5c9c539ab2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:25.340895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9350f-08e8-47ca-a4ae-cd5c9c539ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f9c9350f-08e8-47ca-a4ae-cd5c9c539ab2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:25.345855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:25.346775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:25.347900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:25.351291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 125/248] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:29:25.353219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cd523-9c3f-49a5-b9c3-fd79a82311a1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:25.364285 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9350f-08e8-47ca-a4ae-cd5c9c539ab2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:25.368929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:25.475866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cd523-9c3f-49a5-b9c3-fd79a82311a1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:25.486800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9350f-08e8-47ca-a4ae-cd5c9c539ab2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:25.515483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15e5b7-3ea7-4a2d-ba20-3da88f3aa1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:25.516677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15e5b7-3ea7-4a2d-ba20-3da88f3aa1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:25.516953 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15e5b7-3ea7-4a2d-ba20-3da88f3aa1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:25.517217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15e5b7-3ea7-4a2d-ba20-3da88f3aa1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:25.517877 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15e5b7-3ea7-4a2d-ba20-3da88f3aa1c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:25.518168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15e5b7-3ea7-4a2d-ba20-3da88f3aa1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:25.519582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15e5b7-3ea7-4a2d-ba20-3da88f3aa1c3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:25.533825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 124/249] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:25.537751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15e5b7-3ea7-4a2d-ba20-3da88f3aa1c3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:25.538760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ec8f8-230c-4e7f-93ca-d249fcad5e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:25.539546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ec8f8-230c-4e7f-93ca-d249fcad5e98 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:25.539823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ec8f8-230c-4e7f-93ca-d249fcad5e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:25.540095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ec8f8-230c-4e7f-93ca-d249fcad5e98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:25.554800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ec8f8-230c-4e7f-93ca-d249fcad5e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-c47ec8f8-230c-4e7f-93ca-d249fcad5e98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:25.560004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:25.560907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:25.562881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 126/250] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:25.569145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ec8f8-230c-4e7f-93ca-d249fcad5e98 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:25.593434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:25.658795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:25.678235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15e5b7-3ea7-4a2d-ba20-3da88f3aa1c3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:25.711464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ec8f8-230c-4e7f-93ca-d249fcad5e98 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:25.727643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be03d3-dfdb-486d-8839-3af5d95a7b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:25.728856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be03d3-dfdb-486d-8839-3af5d95a7b4e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:25.729332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be03d3-dfdb-486d-8839-3af5d95a7b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:25.729774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be03d3-dfdb-486d-8839-3af5d95a7b4e None admin] PATH_INFO: `/v3/users/4596919533344f9eb9f5333be1332875` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:25.731384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be03d3-dfdb-486d-8839-3af5d95a7b4e None admin] RBAC: Authorizing `identity:get_user(user_id=4596919533344f9eb9f5333be1332875)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:25.733833 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be03d3-dfdb-486d-8839-3af5d95a7b4e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:25.736604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 125/251] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:25 2022] GET /identity/v3/users/4596919533344f9eb9f5333be1332875 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:25.744010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be03d3-dfdb-486d-8839-3af5d95a7b4e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:25.759615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928c74-8ef8-401b-9d77-f512d7337768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:25.760624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928c74-8ef8-401b-9d77-f512d7337768 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:25.760786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928c74-8ef8-401b-9d77-f512d7337768 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:25.761151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928c74-8ef8-401b-9d77-f512d7337768 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:25.762009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79928c74-8ef8-401b-9d77-f512d7337768 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:25.762384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79928c74-8ef8-401b-9d77-f512d7337768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:25.763930 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79928c74-8ef8-401b-9d77-f512d7337768 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:25.774682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 127/252] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:25.780802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928c74-8ef8-401b-9d77-f512d7337768 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:25.872819 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be03d3-dfdb-486d-8839-3af5d95a7b4e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:25.884292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:25.901764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928c74-8ef8-401b-9d77-f512d7337768 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:25.917462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4960f0-4549-438c-849c-96d473074cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:25.918100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4960f0-4549-438c-849c-96d473074cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:25.918374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4960f0-4549-438c-849c-96d473074cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:25.918638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4960f0-4549-438c-849c-96d473074cb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:25.919940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4960f0-4549-438c-849c-96d473074cb5 None admin] RBAC: Adding query filter params (role.id=28346cbeb7e94e25b52f586669c5beaa, user.id=4596919533344f9eb9f5333be1332875, scope.system=all) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:25.920387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4960f0-4549-438c-849c-96d473074cb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:25.921993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4960f0-4549-438c-849c-96d473074cb5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:25.937444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 126/253] 10.222.0.46 () {56 vars in 1308 bytes} [Mon Oct 24 13:29:25 2022] GET /identity/v3/role_assignments?user.id=4596919533344f9eb9f5333be1332875&scope.system=all&role.id=28346cbeb7e94e25b52f586669c5beaa => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:25.951327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:25.960967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88290506-72f5-430b-8362-5e6d498b9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:25.961670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88290506-72f5-430b-8362-5e6d498b9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:25.961941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88290506-72f5-430b-8362-5e6d498b9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:25.962207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88290506-72f5-430b-8362-5e6d498b9aa8 None admin] PATH_INFO: `/v3/users/70720c09d32640ed85a38b581c0240bc` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:25.964548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88290506-72f5-430b-8362-5e6d498b9aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=70720c09d32640ed85a38b581c0240bc)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:25.966100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88290506-72f5-430b-8362-5e6d498b9aa8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:25.967893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 128/254] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:25 2022] GET /identity/v3/users/70720c09d32640ed85a38b581c0240bc => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:25.973945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4960f0-4549-438c-849c-96d473074cb5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:26.088130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4960f0-4549-438c-849c-96d473074cb5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:26.127459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec02b9-c07c-410e-891c-d7cc1d31ecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:26.128063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec02b9-c07c-410e-891c-d7cc1d31ecf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:26.128336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec02b9-c07c-410e-891c-d7cc1d31ecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:26.128600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec02b9-c07c-410e-891c-d7cc1d31ecf6 None admin] PATH_INFO: `/v3/system/users/70720c09d32640ed85a38b581c0240bc/roles/cdea924879894f8aa246be169f37b2b9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:26.130156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec02b9-c07c-410e-891c-d7cc1d31ecf6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=70720c09d32640ed85a38b581c0240bc, role_id=cdea924879894f8aa246be169f37b2b9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:26.131625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec02b9-c07c-410e-891c-d7cc1d31ecf6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:26.142617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 127/255] 10.222.0.46 () {58 vars in 1334 bytes} [Mon Oct 24 13:29:25 2022] PUT /identity/v3/system/users/70720c09d32640ed85a38b581c0240bc/roles/cdea924879894f8aa246be169f37b2b9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:27.624583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6137-3084-4d36-b07d-53fc0e375338 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:27.625123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6137-3084-4d36-b07d-53fc0e375338 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:27.625123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6137-3084-4d36-b07d-53fc0e375338 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:27.626812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 129/256] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:27.632454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b08d-012c-41f3-ab66-5d8722ab38eb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:27.632895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b08d-012c-41f3-ab66-5d8722ab38eb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:27.633109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b08d-012c-41f3-ab66-5d8722ab38eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:27.659991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6f25b08d-012c-41f3-ab66-5d8722ab38eb None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:27.661213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6f25b08d-012c-41f3-ab66-5d8722ab38eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:27.697559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:27.732395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 128/257] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:29:27.959830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4da76-fcb0-449f-be18-f1de4ae1939c None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:27.960432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4da76-fcb0-449f-be18-f1de4ae1939c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:27.960871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4da76-fcb0-449f-be18-f1de4ae1939c None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:27.962758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 130/258] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:27.968547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db16a0-256e-43e9-be08-cbcb5126b897 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:27.968834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db16a0-256e-43e9-be08-cbcb5126b897 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:27.969102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db16a0-256e-43e9-be08-cbcb5126b897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:27.989412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e0db16a0-256e-43e9-be08-cbcb5126b897 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:27.990606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e0db16a0-256e-43e9-be08-cbcb5126b897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:28.007036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 129/259] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:29:28.260160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4da76-fcb0-449f-be18-f1de4ae1939c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.275645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4da76-fcb0-449f-be18-f1de4ae1939c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.283561 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1361-02de-4944-9f94-7e3a562c65ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.284208 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1361-02de-4944-9f94-7e3a562c65ed admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.284474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1361-02de-4944-9f94-7e3a562c65ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.284736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1361-02de-4944-9f94-7e3a562c65ed admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.300791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c1361-02de-4944-9f94-7e3a562c65ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-580c1361-02de-4944-9f94-7e3a562c65ed admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:28.305692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:28.306590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:28.307407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 131/260] 10.222.0.46 () {56 vars in 1120 bytes} [Mon Oct 24 13:29:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:28.321109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db16a0-256e-43e9-be08-cbcb5126b897 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.331109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db16a0-256e-43e9-be08-cbcb5126b897 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.341991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1361-02de-4944-9f94-7e3a562c65ed admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.343615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.344240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.344517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.344774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.345442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:28.345788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:28.347647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:29:28.347647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: warnings.warn(msg) Oct 24 13:29:28.347647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: Oct 24 13:29:28.348557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:28.356254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1361-02de-4944-9f94-7e3a562c65ed admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.363158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c517e-384d-4885-ac83-d25e1dc825e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.363394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 130/261] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:29:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:28.363798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c517e-384d-4885-ac83-d25e1dc825e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.364070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c517e-384d-4885-ac83-d25e1dc825e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.364337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c517e-384d-4885-ac83-d25e1dc825e2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.386663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.391463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c517e-384d-4885-ac83-d25e1dc825e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3b7c517e-384d-4885-ac83-d25e1dc825e2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:28.397038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:28.399170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:28.401062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 132/262] 10.222.0.46 () {56 vars in 1135 bytes} [Mon Oct 24 13:29:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:28.403449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab639c-8444-4c77-a5f3-374dd42f8dd7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.408126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c517e-384d-4885-ac83-d25e1dc825e2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.412048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60b06-0713-45ce-bafc-4eaf4de0abf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.412863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60b06-0713-45ce-bafc-4eaf4de0abf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.413399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60b06-0713-45ce-bafc-4eaf4de0abf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.413814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60b06-0713-45ce-bafc-4eaf4de0abf5 admin admin] PATH_INFO: `/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.427524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c517e-384d-4885-ac83-d25e1dc825e2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.427939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e60b06-0713-45ce-bafc-4eaf4de0abf5 admin admin] RBAC: Authorizing `identity:get_group(group_id=1f661b56ed2b4d8bb4bc6671b83bddc6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:28.429358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-65e60b06-0713-45ce-bafc-4eaf4de0abf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:29:28.429358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: warnings.warn(msg) Oct 24 13:29:28.429358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: Oct 24 13:29:28.431014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e60b06-0713-45ce-bafc-4eaf4de0abf5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:28.433282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 131/263] 10.222.0.46 () {56 vars in 1201 bytes} [Mon Oct 24 13:29:28 2022] GET /identity/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:28.436411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.437021 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.437290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.437552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.438220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:28.438513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:28.440344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:29:28.440344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: warnings.warn(msg) Oct 24 13:29:28.440344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: Oct 24 13:29:28.441250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:28.452485 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60b06-0713-45ce-bafc-4eaf4de0abf5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.455961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 133/264] 10.222.0.46 () {56 vars in 1132 bytes} [Mon Oct 24 13:29:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:28.461668 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.466220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60b06-0713-45ce-bafc-4eaf4de0abf5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.471353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933bbd1-30b7-49ad-b0fa-1da3375118ac admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.482824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0ad22-609e-4d7a-b91e-a3bfd1609259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.483489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0ad22-609e-4d7a-b91e-a3bfd1609259 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.483839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0ad22-609e-4d7a-b91e-a3bfd1609259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.484106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0ad22-609e-4d7a-b91e-a3bfd1609259 admin admin] PATH_INFO: `/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.484637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d94c-b0ea-4cbf-b690-946fc6719143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.485509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d94c-b0ea-4cbf-b690-946fc6719143 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.485956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d94c-b0ea-4cbf-b690-946fc6719143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.486414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d94c-b0ea-4cbf-b690-946fc6719143 admin admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.487667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0ad22-609e-4d7a-b91e-a3bfd1609259 admin admin] RBAC: Authorizing `identity:get_group(group_id=1f661b56ed2b4d8bb4bc6671b83bddc6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:28.488129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78d94c-b0ea-4cbf-b690-946fc6719143 admin admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:28.488694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-c0b0ad22-609e-4d7a-b91e-a3bfd1609259 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:29:28.488694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: warnings.warn(msg) Oct 24 13:29:28.488694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: Oct 24 13:29:28.489910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0ad22-609e-4d7a-b91e-a3bfd1609259 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:28.491076 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78d94c-b0ea-4cbf-b690-946fc6719143 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:28.491917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 134/265] 10.222.0.46 () {56 vars in 1201 bytes} [Mon Oct 24 13:29:28 2022] GET /identity/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:28.493322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 132/266] 10.222.0.46 () {56 vars in 1207 bytes} [Mon Oct 24 13:29:28 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:28.497572 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0ad22-609e-4d7a-b91e-a3bfd1609259 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.507569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0ad22-609e-4d7a-b91e-a3bfd1609259 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.511569 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d94c-b0ea-4cbf-b690-946fc6719143 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.523315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d94c-b0ea-4cbf-b690-946fc6719143 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.523602 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192bc43-ada0-417d-bc66-297f4588c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.524258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192bc43-ada0-417d-bc66-297f4588c2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.524529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192bc43-ada0-417d-bc66-297f4588c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.524798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192bc43-ada0-417d-bc66-297f4588c2ae admin admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.530964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192bc43-ada0-417d-bc66-297f4588c2ae admin admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:28.530964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192bc43-ada0-417d-bc66-297f4588c2ae admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:28.530964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 135/267] 10.222.0.46 () {56 vars in 1207 bytes} [Mon Oct 24 13:29:28 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:28.535018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cd191-a34c-49ea-9e72-0373b62c9a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.535969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cd191-a34c-49ea-9e72-0373b62c9a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.536091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192bc43-ada0-417d-bc66-297f4588c2ae admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:28.536571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cd191-a34c-49ea-9e72-0373b62c9a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.536998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cd191-a34c-49ea-9e72-0373b62c9a73 admin admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a/groups/1f661b56ed2b4d8bb4bc6671b83bddc6/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.543583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cd191-a34c-49ea-9e72-0373b62c9a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e96fe574b24452931740084b1af95a, group_id=1f661b56ed2b4d8bb4bc6671b83bddc6, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:28.544887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-275cd191-a34c-49ea-9e72-0373b62c9a73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:29:28.544887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: warnings.warn(msg) Oct 24 13:29:28.544887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: Oct 24 13:29:28.547290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cd191-a34c-49ea-9e72-0373b62c9a73 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:28.551586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192bc43-ada0-417d-bc66-297f4588c2ae admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:28.567628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2a756-74b1-4cec-b1a4-cb15bc6beb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:28.568311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a756-74b1-4cec-b1a4-cb15bc6beb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:28.568582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a756-74b1-4cec-b1a4-cb15bc6beb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:28.568857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a756-74b1-4cec-b1a4-cb15bc6beb87 admin admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a/groups/1f661b56ed2b4d8bb4bc6671b83bddc6/roles/53001a60e154408cbe7ea6ad0f2d7e0f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:28.571258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a756-74b1-4cec-b1a4-cb15bc6beb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e96fe574b24452931740084b1af95a, group_id=1f661b56ed2b4d8bb4bc6671b83bddc6, role_id=53001a60e154408cbe7ea6ad0f2d7e0f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:28.572276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-66c2a756-74b1-4cec-b1a4-cb15bc6beb87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:29:28.572276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: warnings.warn(msg) Oct 24 13:29:28.572276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: Oct 24 13:29:28.574374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a756-74b1-4cec-b1a4-cb15bc6beb87 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:28.577936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 133/268] 10.222.0.46 () {58 vars in 1463 bytes} [Mon Oct 24 13:29:28 2022] PUT /identity/v3/projects/e8e96fe574b24452931740084b1af95a/groups/1f661b56ed2b4d8bb4bc6671b83bddc6/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:28.601163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 136/269] 10.222.0.46 () {58 vars in 1463 bytes} [Mon Oct 24 13:29:28 2022] PUT /identity/v3/projects/e8e96fe574b24452931740084b1af95a/groups/1f661b56ed2b4d8bb4bc6671b83bddc6/roles/53001a60e154408cbe7ea6ad0f2d7e0f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:29.154674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eeca5-b591-49b6-972f-99fac0097e47 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.155753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eeca5-b591-49b6-972f-99fac0097e47 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.156220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eeca5-b591-49b6-972f-99fac0097e47 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.158063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 134/270] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:29.170044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da4d3f-0790-498c-be06-5ebdded8f8c7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.170965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da4d3f-0790-498c-be06-5ebdded8f8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.171452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da4d3f-0790-498c-be06-5ebdded8f8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.199977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b2da4d3f-0790-498c-be06-5ebdded8f8c7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:29.201532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b2da4d3f-0790-498c-be06-5ebdded8f8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:29.274651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 137/271] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:29:29.520231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cddeda-e2d5-4ef0-b884-c3bad912725d None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.520529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cddeda-e2d5-4ef0-b884-c3bad912725d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.520873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cddeda-e2d5-4ef0-b884-c3bad912725d None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.522694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 135/272] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:29.529385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405a9c9-5d0e-4821-b743-ac563c61d9cc None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.529667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405a9c9-5d0e-4821-b743-ac563c61d9cc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.529944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405a9c9-5d0e-4821-b743-ac563c61d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.553907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3405a9c9-5d0e-4821-b743-ac563c61d9cc None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:29.555160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3405a9c9-5d0e-4821-b743-ac563c61d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:29.564244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 138/273] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:29:29.663770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cddeda-e2d5-4ef0-b884-c3bad912725d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:29.670741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fdee4-fb28-426f-bdfb-732dbd4940fa None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.671256 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fdee4-fb28-426f-bdfb-732dbd4940fa None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.671387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fdee4-fb28-426f-bdfb-732dbd4940fa None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.673408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 139/274] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:29:29.677858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1cad3-f2cc-4a88-b255-49b25471b52d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.678115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1cad3-f2cc-4a88-b255-49b25471b52d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.678396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1cad3-f2cc-4a88-b255-49b25471b52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.680156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cddeda-e2d5-4ef0-b884-c3bad912725d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:29.686121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ce630-a8ae-464d-91fd-63db0b15d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:29.687396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ce630-a8ae-464d-91fd-63db0b15d036 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.687883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ce630-a8ae-464d-91fd-63db0b15d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.688338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ce630-a8ae-464d-91fd-63db0b15d036 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.708035 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4bb1cad3-f2cc-4a88-b255-49b25471b52d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:29.708616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ce630-a8ae-464d-91fd-63db0b15d036 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:29.709244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4bb1cad3-f2cc-4a88-b255-49b25471b52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d98ce630-a8ae-464d-91fd-63db0b15d036 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:29.714644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:29.715519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:29.716308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:29.723775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 136/275] 10.222.0.46 () {56 vars in 1120 bytes} [Mon Oct 24 13:29:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:29.729733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ce630-a8ae-464d-91fd-63db0b15d036 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:29.745342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ce630-a8ae-464d-91fd-63db0b15d036 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:29.751313 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeab0a6-02ac-41f8-a878-3ab2168d3bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:29.752268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeab0a6-02ac-41f8-a878-3ab2168d3bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.753110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeab0a6-02ac-41f8-a878-3ab2168d3bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.753568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeab0a6-02ac-41f8-a878-3ab2168d3bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.754447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeab0a6-02ac-41f8-a878-3ab2168d3bcd admin admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:29.754986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeab0a6-02ac-41f8-a878-3ab2168d3bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:29.757610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeab0a6-02ac-41f8-a878-3ab2168d3bcd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:29.774421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 137/276] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:29:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:29.780395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeab0a6-02ac-41f8-a878-3ab2168d3bcd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:29.792009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeab0a6-02ac-41f8-a878-3ab2168d3bcd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:29.804722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e30998-0d0e-4913-be23-b8fe387b6797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:29.805715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e30998-0d0e-4913-be23-b8fe387b6797 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.806177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e30998-0d0e-4913-be23-b8fe387b6797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.806629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e30998-0d0e-4913-be23-b8fe387b6797 admin admin] PATH_INFO: `/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.812185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e30998-0d0e-4913-be23-b8fe387b6797 admin admin] RBAC: Authorizing `identity:get_group(group_id=1f661b56ed2b4d8bb4bc6671b83bddc6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:29.814491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e30998-0d0e-4913-be23-b8fe387b6797 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:29.816326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 138/277] 10.222.0.46 () {56 vars in 1201 bytes} [Mon Oct 24 13:29:29 2022] GET /identity/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:29.822308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e30998-0d0e-4913-be23-b8fe387b6797 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:29.835955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e30998-0d0e-4913-be23-b8fe387b6797 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:29.844503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fade45-44b7-4ba1-a3f8-45f9d162b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:29.845436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fade45-44b7-4ba1-a3f8-45f9d162b283 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.845932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fade45-44b7-4ba1-a3f8-45f9d162b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.846384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fade45-44b7-4ba1-a3f8-45f9d162b283 admin admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.848793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fade45-44b7-4ba1-a3f8-45f9d162b283 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:29.851751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fade45-44b7-4ba1-a3f8-45f9d162b283 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:29.854347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 139/278] 10.222.0.46 () {56 vars in 1207 bytes} [Mon Oct 24 13:29:29 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:29.859727 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fade45-44b7-4ba1-a3f8-45f9d162b283 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:29.881178 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 140/279] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:29:29.881365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fade45-44b7-4ba1-a3f8-45f9d162b283 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:29.893277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b8f76-08c5-47c1-a497-5eb6a76c2d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:29.894075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b8f76-08c5-47c1-a497-5eb6a76c2d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:29.894333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b8f76-08c5-47c1-a497-5eb6a76c2d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:29.894600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b8f76-08c5-47c1-a497-5eb6a76c2d50 admin admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/groups/1f661b56ed2b4d8bb4bc6671b83bddc6/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:29.900189 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b8f76-08c5-47c1-a497-5eb6a76c2d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a370bf40ca4f53b61878f62d5d2333, group_id=1f661b56ed2b4d8bb4bc6671b83bddc6, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:29.903299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b8f76-08c5-47c1-a497-5eb6a76c2d50 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:29.936831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 140/280] 10.222.0.46 () {58 vars in 1463 bytes} [Mon Oct 24 13:29:29 2022] PUT /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/groups/1f661b56ed2b4d8bb4bc6671b83bddc6/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:29.940198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1cad3-f2cc-4a88-b255-49b25471b52d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:29.955999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:30.044151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1cad3-f2cc-4a88-b255-49b25471b52d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:30.052800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6878da8-1b58-4206-a529-ab04728f9c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:30.053473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878da8-1b58-4206-a529-ab04728f9c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.054508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878da8-1b58-4206-a529-ab04728f9c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.054789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878da8-1b58-4206-a529-ab04728f9c1c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.083081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6878da8-1b58-4206-a529-ab04728f9c1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f6878da8-1b58-4206-a529-ab04728f9c1c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:30.088918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:30.089834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:30.090605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 141/281] 10.222.0.46 () {56 vars in 1135 bytes} [Mon Oct 24 13:29:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:30.100096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b8f76-08c5-47c1-a497-5eb6a76c2d50 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:30.121681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b8f76-08c5-47c1-a497-5eb6a76c2d50 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:30.132615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb09a07-f806-4293-a585-323b60bed689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:30.133254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb09a07-f806-4293-a585-323b60bed689 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.133529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb09a07-f806-4293-a585-323b60bed689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.133797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb09a07-f806-4293-a585-323b60bed689 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.134509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb09a07-f806-4293-a585-323b60bed689 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:30.134809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb09a07-f806-4293-a585-323b60bed689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:30.136522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb09a07-f806-4293-a585-323b60bed689 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:30.157580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 141/282] 10.222.0.46 () {56 vars in 1132 bytes} [Mon Oct 24 13:29:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:30.163473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6878da8-1b58-4206-a529-ab04728f9c1c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:30.177247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6878da8-1b58-4206-a529-ab04728f9c1c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:30.183155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f875d2-f915-4c07-a7da-39fba3af1974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:30.183810 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f875d2-f915-4c07-a7da-39fba3af1974 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.184082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f875d2-f915-4c07-a7da-39fba3af1974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.184348 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f875d2-f915-4c07-a7da-39fba3af1974 admin admin] PATH_INFO: `/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.185454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f875d2-f915-4c07-a7da-39fba3af1974 admin admin] RBAC: Authorizing `identity:get_group(group_id=1f661b56ed2b4d8bb4bc6671b83bddc6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:30.193373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f875d2-f915-4c07-a7da-39fba3af1974 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:30.193373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 142/283] 10.222.0.46 () {56 vars in 1201 bytes} [Mon Oct 24 13:29:30 2022] GET /identity/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:30.199383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb09a07-f806-4293-a585-323b60bed689 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:30.213098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb09a07-f806-4293-a585-323b60bed689 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:30.218533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1c40a-e712-4ddd-b2cf-f221550d9f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:30.219205 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1c40a-e712-4ddd-b2cf-f221550d9f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.219479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1c40a-e712-4ddd-b2cf-f221550d9f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.219744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1c40a-e712-4ddd-b2cf-f221550d9f8b admin admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.223596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1c40a-e712-4ddd-b2cf-f221550d9f8b admin admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:30.226259 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1c40a-e712-4ddd-b2cf-f221550d9f8b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:30.228306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 142/284] 10.222.0.46 () {56 vars in 1207 bytes} [Mon Oct 24 13:29:30 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:30.234186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f875d2-f915-4c07-a7da-39fba3af1974 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:30.248519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f875d2-f915-4c07-a7da-39fba3af1974 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:30.255127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dbe5b-a44d-45de-abcd-45c545a0e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:30.255796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dbe5b-a44d-45de-abcd-45c545a0e1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.256065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dbe5b-a44d-45de-abcd-45c545a0e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.256329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dbe5b-a44d-45de-abcd-45c545a0e1a8 admin admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/groups/1f661b56ed2b4d8bb4bc6671b83bddc6/roles/53001a60e154408cbe7ea6ad0f2d7e0f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.261686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dbe5b-a44d-45de-abcd-45c545a0e1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a370bf40ca4f53b61878f62d5d2333, group_id=1f661b56ed2b4d8bb4bc6671b83bddc6, role_id=53001a60e154408cbe7ea6ad0f2d7e0f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:30.264347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dbe5b-a44d-45de-abcd-45c545a0e1a8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:30.287924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 143/285] 10.222.0.46 () {58 vars in 1463 bytes} [Mon Oct 24 13:29:30 2022] PUT /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333/groups/1f661b56ed2b4d8bb4bc6671b83bddc6/roles/53001a60e154408cbe7ea6ad0f2d7e0f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:30.359537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1c40a-e712-4ddd-b2cf-f221550d9f8b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:30.479416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:30.506619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1c40a-e712-4ddd-b2cf-f221550d9f8b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:30.557649 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b2ee2-7343-4d73-bec1-014dafcde6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:30.558316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2ee2-7343-4d73-bec1-014dafcde6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.558597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2ee2-7343-4d73-bec1-014dafcde6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.558868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2ee2-7343-4d73-bec1-014dafcde6c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.577217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b2ee2-7343-4d73-bec1-014dafcde6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-8b7b2ee2-7343-4d73-bec1-014dafcde6c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:30.582826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:30.583781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:30.585072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 143/286] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:30.590426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dbe5b-a44d-45de-abcd-45c545a0e1a8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:30.739921 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dbe5b-a44d-45de-abcd-45c545a0e1a8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:30.781588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e5cb8-1b04-45ca-bd36-25f48b823744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:30.782267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e5cb8-1b04-45ca-bd36-25f48b823744 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.782482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e5cb8-1b04-45ca-bd36-25f48b823744 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.782744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e5cb8-1b04-45ca-bd36-25f48b823744 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.783494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e5cb8-1b04-45ca-bd36-25f48b823744 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:30.783794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e5cb8-1b04-45ca-bd36-25f48b823744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:30.784326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7fe44-4ad6-45a5-870e-73f36e9f9e0b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.784606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7fe44-4ad6-45a5-870e-73f36e9f9e0b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.784878 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7fe44-4ad6-45a5-870e-73f36e9f9e0b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.785149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e5cb8-1b04-45ca-bd36-25f48b823744 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:30.786450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 144/287] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:30.788138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:30.793882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fe87e-b824-4c7b-9e1d-baf81d6f1905 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.794153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fe87e-b824-4c7b-9e1d-baf81d6f1905 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.794417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fe87e-b824-4c7b-9e1d-baf81d6f1905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.798624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 144/288] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:30.805275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e5cb8-1b04-45ca-bd36-25f48b823744 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:30.836273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b96fe87e-b824-4c7b-9e1d-baf81d6f1905 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:30.837525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b96fe87e-b824-4c7b-9e1d-baf81d6f1905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:30.922149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e5cb8-1b04-45ca-bd36-25f48b823744 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:30.970782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 145/289] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:29:30.971484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f6169-a2f3-4383-8e22-879859ae16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:30.972139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6169-a2f3-4383-8e22-879859ae16f5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:30.972410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6169-a2f3-4383-8e22-879859ae16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:30.972676 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6169-a2f3-4383-8e22-879859ae16f5 None admin] PATH_INFO: `/v3/users/70720c09d32640ed85a38b581c0240bc` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:30.973853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6169-a2f3-4383-8e22-879859ae16f5 None admin] RBAC: Authorizing `identity:get_user(user_id=70720c09d32640ed85a38b581c0240bc)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:30.975321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6169-a2f3-4383-8e22-879859ae16f5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:30.977240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 145/290] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:29:30 2022] GET /identity/v3/users/70720c09d32640ed85a38b581c0240bc => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:30.983123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fe87e-b824-4c7b-9e1d-baf81d6f1905 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:31.104131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:31.123900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fe87e-b824-4c7b-9e1d-baf81d6f1905 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:31.170386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269b460-5448-4abc-ba55-3f01c8c24750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:31.171052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269b460-5448-4abc-ba55-3f01c8c24750 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:31.171286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269b460-5448-4abc-ba55-3f01c8c24750 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:31.171545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269b460-5448-4abc-ba55-3f01c8c24750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:31.172256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269b460-5448-4abc-ba55-3f01c8c24750 None admin] RBAC: Adding query filter params (role.id=cdea924879894f8aa246be169f37b2b9, user.id=70720c09d32640ed85a38b581c0240bc, scope.system=all) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:31.172553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269b460-5448-4abc-ba55-3f01c8c24750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:31.173992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269b460-5448-4abc-ba55-3f01c8c24750 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:31.190191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 146/291] 10.222.0.46 () {56 vars in 1308 bytes} [Mon Oct 24 13:29:30 2022] GET /identity/v3/role_assignments?user.id=70720c09d32640ed85a38b581c0240bc&scope.system=all&role.id=cdea924879894f8aa246be169f37b2b9 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:31.415977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f6169-a2f3-4383-8e22-879859ae16f5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:31.427643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f6169-a2f3-4383-8e22-879859ae16f5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:31.432569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29b20d-1866-44f1-acee-230f35b36403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:31.433204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b20d-1866-44f1-acee-230f35b36403 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:31.433474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b20d-1866-44f1-acee-230f35b36403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:31.433739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b20d-1866-44f1-acee-230f35b36403 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:31.445770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29b20d-1866-44f1-acee-230f35b36403 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-be29b20d-1866-44f1-acee-230f35b36403 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:31.450788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:31.451673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:31.453050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 146/292] 10.222.0.46 () {56 vars in 1117 bytes} [Mon Oct 24 13:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:31.457873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269b460-5448-4abc-ba55-3f01c8c24750 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:31.469768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269b460-5448-4abc-ba55-3f01c8c24750 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:31.474253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f02a-325b-4a4b-8340-94bb5f8408ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:31.474864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f02a-325b-4a4b-8340-94bb5f8408ef admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:31.475164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f02a-325b-4a4b-8340-94bb5f8408ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:31.475531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f02a-325b-4a4b-8340-94bb5f8408ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:31.476200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f02a-325b-4a4b-8340-94bb5f8408ef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:31.476492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f02a-325b-4a4b-8340-94bb5f8408ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:31.478157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f02a-325b-4a4b-8340-94bb5f8408ef admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:31.487827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 147/293] 10.222.0.46 () {56 vars in 1120 bytes} [Mon Oct 24 13:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:31.493554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29b20d-1866-44f1-acee-230f35b36403 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:31.503786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29b20d-1866-44f1-acee-230f35b36403 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:31.509935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240605-6b83-40bc-8424-728c55e310a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:31.510580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240605-6b83-40bc-8424-728c55e310a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:31.510846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240605-6b83-40bc-8424-728c55e310a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:31.511206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240605-6b83-40bc-8424-728c55e310a2 admin admin] PATH_INFO: `/v3/groups/5c038e799e8441e6ad80bc6402da7102` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:31.518016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc240605-6b83-40bc-8424-728c55e310a2 admin admin] RBAC: Authorizing `identity:get_group(group_id=5c038e799e8441e6ad80bc6402da7102)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:31.520085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc240605-6b83-40bc-8424-728c55e310a2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:31.522055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 147/294] 10.222.0.46 () {56 vars in 1201 bytes} [Mon Oct 24 13:29:31 2022] GET /identity/v3/groups/5c038e799e8441e6ad80bc6402da7102 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:31.528195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f02a-325b-4a4b-8340-94bb5f8408ef admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:31.538746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f02a-325b-4a4b-8340-94bb5f8408ef admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:31.544784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4253dcf-5ae0-49e9-bc61-ee49b2a3aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:31.545479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4253dcf-5ae0-49e9-bc61-ee49b2a3aad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:31.545747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4253dcf-5ae0-49e9-bc61-ee49b2a3aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:31.546013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4253dcf-5ae0-49e9-bc61-ee49b2a3aad3 admin admin] PATH_INFO: `/v3/projects/2412fb672dec485f9e4dda53e202b718` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:31.547196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4253dcf-5ae0-49e9-bc61-ee49b2a3aad3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2412fb672dec485f9e4dda53e202b718)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:31.549223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4253dcf-5ae0-49e9-bc61-ee49b2a3aad3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:31.550905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 148/295] 10.222.0.46 () {56 vars in 1207 bytes} [Mon Oct 24 13:29:31 2022] GET /identity/v3/projects/2412fb672dec485f9e4dda53e202b718 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:31.557006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240605-6b83-40bc-8424-728c55e310a2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:31.572334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240605-6b83-40bc-8424-728c55e310a2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:31.583231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ff3c-692c-433f-a4c9-417f5c665261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:31.583924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ff3c-692c-433f-a4c9-417f5c665261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:31.584195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ff3c-692c-433f-a4c9-417f5c665261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:31.584464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ff3c-692c-433f-a4c9-417f5c665261 admin admin] PATH_INFO: `/v3/projects/2412fb672dec485f9e4dda53e202b718/groups/5c038e799e8441e6ad80bc6402da7102/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:31.592351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044ff3c-692c-433f-a4c9-417f5c665261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2412fb672dec485f9e4dda53e202b718, group_id=5c038e799e8441e6ad80bc6402da7102, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:31.595058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044ff3c-692c-433f-a4c9-417f5c665261 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:31.625432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 148/296] 10.222.0.46 () {58 vars in 1463 bytes} [Mon Oct 24 13:29:31 2022] PUT /identity/v3/projects/2412fb672dec485f9e4dda53e202b718/groups/5c038e799e8441e6ad80bc6402da7102/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:32.086623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f9ec-7c63-418f-8fde-fd58fdf8d355 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:32.087130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f9ec-7c63-418f-8fde-fd58fdf8d355 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:32.087309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f9ec-7c63-418f-8fde-fd58fdf8d355 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:32.089051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 149/297] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:32.094269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b19e73-4c52-46bd-b88f-371ad1c37865 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:32.094536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b19e73-4c52-46bd-b88f-371ad1c37865 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:32.094807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b19e73-4c52-46bd-b88f-371ad1c37865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:32.120147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-27b19e73-4c52-46bd-b88f-371ad1c37865 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:32.121344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-27b19e73-4c52-46bd-b88f-371ad1c37865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:32.155672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:32.225920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 149/298] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:32.429446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a222b-845f-470c-920f-057c59205a6c None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:32.430104 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a222b-845f-470c-920f-057c59205a6c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:32.430104 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a222b-845f-470c-920f-057c59205a6c None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:32.431631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 150/299] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:32.437364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af892bce-f68b-4dda-89de-3fb9238c0118 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:32.437869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af892bce-f68b-4dda-89de-3fb9238c0118 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:32.438032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af892bce-f68b-4dda-89de-3fb9238c0118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:32.463999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-af892bce-f68b-4dda-89de-3fb9238c0118 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:32.465211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-af892bce-f68b-4dda-89de-3fb9238c0118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:32.549425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 150/300] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:32.579764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a222b-845f-470c-920f-057c59205a6c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:32.736287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a222b-845f-470c-920f-057c59205a6c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:32.777348 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:32.789348 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75d2ed-3f05-41ab-8484-3967fe38b22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:32.790371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d2ed-3f05-41ab-8484-3967fe38b22d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:32.790845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d2ed-3f05-41ab-8484-3967fe38b22d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:32.791320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d2ed-3f05-41ab-8484-3967fe38b22d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:32.807621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75d2ed-3f05-41ab-8484-3967fe38b22d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ee75d2ed-3f05-41ab-8484-3967fe38b22d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:32.812854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:32.813750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:32.814560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:32.816903 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 151/301] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:32.823423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af892bce-f68b-4dda-89de-3fb9238c0118 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:32.949633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75d2ed-3f05-41ab-8484-3967fe38b22d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:32.953507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:32.969235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af892bce-f68b-4dda-89de-3fb9238c0118 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:33.040360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc871719-eeb2-4abe-8a53-bd7eeb4119d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:33.041005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc871719-eeb2-4abe-8a53-bd7eeb4119d6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.041268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc871719-eeb2-4abe-8a53-bd7eeb4119d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.041536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc871719-eeb2-4abe-8a53-bd7eeb4119d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.042250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc871719-eeb2-4abe-8a53-bd7eeb4119d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:33.042526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc871719-eeb2-4abe-8a53-bd7eeb4119d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:33.043988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc871719-eeb2-4abe-8a53-bd7eeb4119d6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:33.062606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 151/302] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:33.069159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc871719-eeb2-4abe-8a53-bd7eeb4119d6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:33.113993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75d2ed-3f05-41ab-8484-3967fe38b22d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:33.162420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa345d-986f-418c-a89e-dbee243809f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:33.163536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa345d-986f-418c-a89e-dbee243809f0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.163993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa345d-986f-418c-a89e-dbee243809f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.164438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa345d-986f-418c-a89e-dbee243809f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.177524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa345d-986f-418c-a89e-dbee243809f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2cfa345d-986f-418c-a89e-dbee243809f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:33.184644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:33.185542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:33.186327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:33.189080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 152/303] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:29:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:29:33.195425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa345d-986f-418c-a89e-dbee243809f0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:33.267346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:33.313508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc871719-eeb2-4abe-8a53-bd7eeb4119d6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:33.344931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa345d-986f-418c-a89e-dbee243809f0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:33.357468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7ce0f-c9f9-41fc-8bba-ee0dba45f1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:33.358366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7ce0f-c9f9-41fc-8bba-ee0dba45f1ce None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.359067 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7ce0f-c9f9-41fc-8bba-ee0dba45f1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.359476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7ce0f-c9f9-41fc-8bba-ee0dba45f1ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.393981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:33.404358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505283c-f724-4e7a-aba0-fa4f67760e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:33.405243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505283c-f724-4e7a-aba0-fa4f67760e85 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.405679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505283c-f724-4e7a-aba0-fa4f67760e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.406096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505283c-f724-4e7a-aba0-fa4f67760e85 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.406910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505283c-f724-4e7a-aba0-fa4f67760e85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:33.407399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505283c-f724-4e7a-aba0-fa4f67760e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:33.411747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505283c-f724-4e7a-aba0-fa4f67760e85 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:33.426796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 153/304] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:33.428628 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab69517-8fb5-4c6a-9da9-94f3a9da4f4b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.429093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab69517-8fb5-4c6a-9da9-94f3a9da4f4b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.429552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab69517-8fb5-4c6a-9da9-94f3a9da4f4b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.431977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 154/305] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:33.440610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf582-36ce-4e9a-98f8-a4e86323d053 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.440906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf582-36ce-4e9a-98f8-a4e86323d053 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.441147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf582-36ce-4e9a-98f8-a4e86323d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.442676 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7ce0f-c9f9-41fc-8bba-ee0dba45f1ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:33.444444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7ce0f-c9f9-41fc-8bba-ee0dba45f1ce None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:33.469255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f8ecf582-36ce-4e9a-98f8-a4e86323d053 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:33.470911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f8ecf582-36ce-4e9a-98f8-a4e86323d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:33.570387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 155/306] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:33.573308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 152/307] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:33.583315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecf582-36ce-4e9a-98f8-a4e86323d053 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:33.600806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7ce0f-c9f9-41fc-8bba-ee0dba45f1ce None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:33.664563 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:33.686192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:33.742024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecf582-36ce-4e9a-98f8-a4e86323d053 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:33.749067 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7ce0f-c9f9-41fc-8bba-ee0dba45f1ce None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:33.787580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7f03c-d151-4b7c-8821-d6dbc5967c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:33.788803 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7f03c-d151-4b7c-8821-d6dbc5967c27 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.789298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7f03c-d151-4b7c-8821-d6dbc5967c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.789776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7f03c-d151-4b7c-8821-d6dbc5967c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.797068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b136-fcd9-4946-9a24-1b42c1a647cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:33.797702 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b136-fcd9-4946-9a24-1b42c1a647cf None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.797971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b136-fcd9-4946-9a24-1b42c1a647cf None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.798236 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b136-fcd9-4946-9a24-1b42c1a647cf None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.799419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484b136-fcd9-4946-9a24-1b42c1a647cf None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:33.800993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484b136-fcd9-4946-9a24-1b42c1a647cf None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:33.802636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 153/308] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:33 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:33.807995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f2c23-597e-498e-8686-155f306ace5d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.808146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f2c23-597e-498e-8686-155f306ace5d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.808344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f2c23-597e-498e-8686-155f306ace5d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.809598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 154/309] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:33.812216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f2c23-597e-498e-8686-155f306ace5d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:33.886198 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7f03c-d151-4b7c-8821-d6dbc5967c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:33.887641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7f03c-d151-4b7c-8821-d6dbc5967c27 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:33.944350 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:33.946088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f2c23-597e-498e-8686-155f306ace5d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:33.972003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:33.985955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73fb70-e9f5-4f53-b8c8-7f59d8865735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:33.986592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73fb70-e9f5-4f53-b8c8-7f59d8865735 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.986861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73fb70-e9f5-4f53-b8c8-7f59d8865735 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.987157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73fb70-e9f5-4f53-b8c8-7f59d8865735 None admin] PATH_INFO: `/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:33.988653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73fb70-e9f5-4f53-b8c8-7f59d8865735 None admin] RBAC: Authorizing `identity:get_group(group_id=1f661b56ed2b4d8bb4bc6671b83bddc6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:33.990467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73fb70-e9f5-4f53-b8c8-7f59d8865735 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:33.993943 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 155/310] 10.222.0.46 () {56 vars in 1180 bytes} [Mon Oct 24 13:29:33 2022] GET /identity/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:33.994329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e60d7-4029-4fd1-859d-d8874573d21b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:33.994606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e60d7-4029-4fd1-859d-d8874573d21b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:33.994869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e60d7-4029-4fd1-859d-d8874573d21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.019737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-351e60d7-4029-4fd1-859d-d8874573d21b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:34.021416 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-351e60d7-4029-4fd1-859d-d8874573d21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:34.026641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 156/311] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:34.027890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7f03c-d151-4b7c-8821-d6dbc5967c27 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:34.108578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 156/312] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:34.109599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e60d7-4029-4fd1-859d-d8874573d21b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:34.150972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7f03c-d151-4b7c-8821-d6dbc5967c27 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:34.195933 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779799c-3eab-455a-bfab-3256cfeb455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:34.197051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779799c-3eab-455a-bfab-3256cfeb455a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.197415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779799c-3eab-455a-bfab-3256cfeb455a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.197754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779799c-3eab-455a-bfab-3256cfeb455a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.212833 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779799c-3eab-455a-bfab-3256cfeb455a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c779799c-3eab-455a-bfab-3256cfeb455a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:34.218004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:34.218871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:29:34.219672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:34.221527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 157/313] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:34.222609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779799c-3eab-455a-bfab-3256cfeb455a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:34.227191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:34.242550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e60d7-4029-4fd1-859d-d8874573d21b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:34.268179 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:34.291780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b191c-28bf-4700-9d8d-597d0cfc252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:34.292453 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b191c-28bf-4700-9d8d-597d0cfc252d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.292800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b191c-28bf-4700-9d8d-597d0cfc252d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.293190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b191c-28bf-4700-9d8d-597d0cfc252d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.294309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b191c-28bf-4700-9d8d-597d0cfc252d None admin] RBAC: Adding query filter params (group.id=1f661b56ed2b4d8bb4bc6671b83bddc6, role.id=28346cbeb7e94e25b52f586669c5beaa, scope.project.id=e8e96fe574b24452931740084b1af95a) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:34.294685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b191c-28bf-4700-9d8d-597d0cfc252d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:34.296962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b191c-28bf-4700-9d8d-597d0cfc252d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:34.305238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 157/314] 10.222.0.46 () {56 vars in 1376 bytes} [Mon Oct 24 13:29:34 2022] GET /identity/v3/role_assignments?group.id=1f661b56ed2b4d8bb4bc6671b83bddc6&scope.project.id=e8e96fe574b24452931740084b1af95a&role.id=28346cbeb7e94e25b52f586669c5beaa => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:34.310694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b191c-28bf-4700-9d8d-597d0cfc252d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:34.356703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779799c-3eab-455a-bfab-3256cfeb455a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:34.401677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd3219-0464-4056-9321-0ab0150619a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:34.403033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd3219-0464-4056-9321-0ab0150619a8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.403478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd3219-0464-4056-9321-0ab0150619a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.403990 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd3219-0464-4056-9321-0ab0150619a8 None admin] PATH_INFO: `/v3/projects/e8e96fe574b24452931740084b1af95a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.405420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd3219-0464-4056-9321-0ab0150619a8 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e96fe574b24452931740084b1af95a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:34.407185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd3219-0464-4056-9321-0ab0150619a8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:34.409147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 158/315] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:34 2022] GET /identity/v3/projects/e8e96fe574b24452931740084b1af95a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:34.414970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd3219-0464-4056-9321-0ab0150619a8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:34.454798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b191c-28bf-4700-9d8d-597d0cfc252d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:34.511699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a105d-d7af-40d6-9902-3131ebb57097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:34.512979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a105d-d7af-40d6-9902-3131ebb57097 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.513435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a105d-d7af-40d6-9902-3131ebb57097 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.513877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a105d-d7af-40d6-9902-3131ebb57097 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.515550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a105d-d7af-40d6-9902-3131ebb57097 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:34.516393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a105d-d7af-40d6-9902-3131ebb57097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:34.517801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:34.519608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a105d-d7af-40d6-9902-3131ebb57097 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:34.533062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 158/316] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:29:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:34.534704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a105d-d7af-40d6-9902-3131ebb57097 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:34.565466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd3219-0464-4056-9321-0ab0150619a8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:34.605450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:34.614428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dffb7e-5e94-4dc9-aa85-330f04e0ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:34.615108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dffb7e-5e94-4dc9-aa85-330f04e0ff52 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.615380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dffb7e-5e94-4dc9-aa85-330f04e0ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.615646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dffb7e-5e94-4dc9-aa85-330f04e0ff52 None admin] PATH_INFO: `/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.616928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dffb7e-5e94-4dc9-aa85-330f04e0ff52 None admin] RBAC: Authorizing `identity:get_group(group_id=1f661b56ed2b4d8bb4bc6671b83bddc6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:34.618381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dffb7e-5e94-4dc9-aa85-330f04e0ff52 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:34.620216 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 159/317] 10.222.0.46 () {56 vars in 1180 bytes} [Mon Oct 24 13:29:34 2022] GET /identity/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:34.622339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b9778-37ce-4130-8841-d5a00f0135bf None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.622609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b9778-37ce-4130-8841-d5a00f0135bf None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.622869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b9778-37ce-4130-8841-d5a00f0135bf None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.624280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 160/318] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:34.624846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b9778-37ce-4130-8841-d5a00f0135bf None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:34.681750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a105d-d7af-40d6-9902-3131ebb57097 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:34.719243 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e4254-763b-4603-a79d-f4dad409b7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:34.719878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4254-763b-4603-a79d-f4dad409b7bd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.720564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4254-763b-4603-a79d-f4dad409b7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.720564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4254-763b-4603-a79d-f4dad409b7bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.731064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e4254-763b-4603-a79d-f4dad409b7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-5a7e4254-763b-4603-a79d-f4dad409b7bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:34.736427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:34.737367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:34.738381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 159/319] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:29:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:34.739250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e4254-763b-4603-a79d-f4dad409b7bd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:34.757031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b9778-37ce-4130-8841-d5a00f0135bf None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:34.794658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865201f5-fd3d-4706-99f0-ed4b4a7452e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:34.796505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865201f5-fd3d-4706-99f0-ed4b4a7452e1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.796505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865201f5-fd3d-4706-99f0-ed4b4a7452e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.796505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865201f5-fd3d-4706-99f0-ed4b4a7452e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.805665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:34.853257 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e4254-763b-4603-a79d-f4dad409b7bd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:34.861299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:34.880022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865201f5-fd3d-4706-99f0-ed4b4a7452e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:34.881737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865201f5-fd3d-4706-99f0-ed4b4a7452e1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:34.896303 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63fda7-fe8f-4942-a65e-640ada92ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:34.896918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63fda7-fe8f-4942-a65e-640ada92ee12 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.897250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63fda7-fe8f-4942-a65e-640ada92ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.897524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63fda7-fe8f-4942-a65e-640ada92ee12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.898254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63fda7-fe8f-4942-a65e-640ada92ee12 None admin] RBAC: Adding query filter params (group.id=1f661b56ed2b4d8bb4bc6671b83bddc6, role.id=53001a60e154408cbe7ea6ad0f2d7e0f, scope.project.id=e8e96fe574b24452931740084b1af95a) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:34.898557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63fda7-fe8f-4942-a65e-640ada92ee12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:34.900033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63fda7-fe8f-4942-a65e-640ada92ee12 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:34.907385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 160/320] 10.222.0.46 () {56 vars in 1376 bytes} [Mon Oct 24 13:29:34 2022] GET /identity/v3/role_assignments?group.id=1f661b56ed2b4d8bb4bc6671b83bddc6&scope.project.id=e8e96fe574b24452931740084b1af95a&role.id=53001a60e154408cbe7ea6ad0f2d7e0f => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:34.909398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88172d5-4384-4de3-98b4-5b883fa3ccbf None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:34.910625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88172d5-4384-4de3-98b4-5b883fa3ccbf None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:34.910625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88172d5-4384-4de3-98b4-5b883fa3ccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:34.934978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e88172d5-4384-4de3-98b4-5b883fa3ccbf None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:34.936132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e88172d5-4384-4de3-98b4-5b883fa3ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:35.012757 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 161/321] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:35.014005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865201f5-fd3d-4706-99f0-ed4b4a7452e1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.034526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 161/322] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:35.035265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88172d5-4384-4de3-98b4-5b883fa3ccbf None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.084753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:35.165750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865201f5-fd3d-4706-99f0-ed4b4a7452e1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:35.174532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88172d5-4384-4de3-98b4-5b883fa3ccbf None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:35.176525 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:35.211760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610d01-c65c-40f4-9ca8-ea35d4a44b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:35.212383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610d01-c65c-40f4-9ca8-ea35d4a44b31 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:35.212672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610d01-c65c-40f4-9ca8-ea35d4a44b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:35.213152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610d01-c65c-40f4-9ca8-ea35d4a44b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:35.213715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41610d01-c65c-40f4-9ca8-ea35d4a44b31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:35.213995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41610d01-c65c-40f4-9ca8-ea35d4a44b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:35.215493 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41610d01-c65c-40f4-9ca8-ea35d4a44b31 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:35.223882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a862160-e64d-4d83-8f3d-09c2163549e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:35.224521 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a862160-e64d-4d83-8f3d-09c2163549e6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:35.224799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a862160-e64d-4d83-8f3d-09c2163549e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:35.225067 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a862160-e64d-4d83-8f3d-09c2163549e6 None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:35.227697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a862160-e64d-4d83-8f3d-09c2163549e6 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:35.228282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 162/323] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:35.229279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a862160-e64d-4d83-8f3d-09c2163549e6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:35.231082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 162/324] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:35.233877 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610d01-c65c-40f4-9ca8-ea35d4a44b31 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.238384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a862160-e64d-4d83-8f3d-09c2163549e6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.347552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:35.350744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610d01-c65c-40f4-9ca8-ea35d4a44b31 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:35.361948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a862160-e64d-4d83-8f3d-09c2163549e6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:35.393102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce3c8e-71d2-4d36-83ef-7831038ac233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:35.394245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3c8e-71d2-4d36-83ef-7831038ac233 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:35.394518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3c8e-71d2-4d36-83ef-7831038ac233 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:35.395148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3c8e-71d2-4d36-83ef-7831038ac233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:35.407712 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe5764-3f03-4b74-8fa7-f4634bfcfcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:35.408351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe5764-3f03-4b74-8fa7-f4634bfcfcbc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:35.408625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe5764-3f03-4b74-8fa7-f4634bfcfcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:35.408896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe5764-3f03-4b74-8fa7-f4634bfcfcbc None admin] PATH_INFO: `/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:35.409981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe5764-3f03-4b74-8fa7-f4634bfcfcbc None admin] RBAC: Authorizing `identity:get_group(group_id=1f661b56ed2b4d8bb4bc6671b83bddc6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:35.411442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe5764-3f03-4b74-8fa7-f4634bfcfcbc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:35.414360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 163/325] 10.222.0.46 () {56 vars in 1180 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:35.414360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe5764-3f03-4b74-8fa7-f4634bfcfcbc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.451488 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:35.478718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce3c8e-71d2-4d36-83ef-7831038ac233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:35.480140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce3c8e-71d2-4d36-83ef-7831038ac233 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:35.533377 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe5764-3f03-4b74-8fa7-f4634bfcfcbc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:35.579074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2045c92-a550-4a7d-8441-a2eb89ae359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:35.579701 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2045c92-a550-4a7d-8441-a2eb89ae359d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:35.579976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2045c92-a550-4a7d-8441-a2eb89ae359d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:35.580260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2045c92-a550-4a7d-8441-a2eb89ae359d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:35.589202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:35.592460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2045c92-a550-4a7d-8441-a2eb89ae359d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:35.594621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 163/326] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:35.595500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce3c8e-71d2-4d36-83ef-7831038ac233 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b2045c92-a550-4a7d-8441-a2eb89ae359d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:35.597900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:35.598749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:35.599648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 164/327] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:35.601643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2045c92-a550-4a7d-8441-a2eb89ae359d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.697957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:35.703185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce3c8e-71d2-4d36-83ef-7831038ac233 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:35.704090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2045c92-a550-4a7d-8441-a2eb89ae359d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:35.738839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4387d0-42e6-4095-95a0-8ae549ed3428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:35.739233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848d33-a20a-46ef-a817-99bc8660c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:35.739407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4387d0-42e6-4095-95a0-8ae549ed3428 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:35.739677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4387d0-42e6-4095-95a0-8ae549ed3428 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:35.739842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848d33-a20a-46ef-a817-99bc8660c38e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:35.739930 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4387d0-42e6-4095-95a0-8ae549ed3428 None admin] PATH_INFO: `/v3/projects/a6a370bf40ca4f53b61878f62d5d2333` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:35.740122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848d33-a20a-46ef-a817-99bc8660c38e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:35.740393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848d33-a20a-46ef-a817-99bc8660c38e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:35.741157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54848d33-a20a-46ef-a817-99bc8660c38e None admin] RBAC: Adding query filter params (group.id=1f661b56ed2b4d8bb4bc6671b83bddc6, role.id=28346cbeb7e94e25b52f586669c5beaa, scope.project.id=a6a370bf40ca4f53b61878f62d5d2333) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:35.741265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4387d0-42e6-4095-95a0-8ae549ed3428 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a370bf40ca4f53b61878f62d5d2333)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:35.741459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54848d33-a20a-46ef-a817-99bc8660c38e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:35.742728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4387d0-42e6-4095-95a0-8ae549ed3428 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:35.743127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54848d33-a20a-46ef-a817-99bc8660c38e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:35.744392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 165/328] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/projects/a6a370bf40ca4f53b61878f62d5d2333 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:35.747774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4387d0-42e6-4095-95a0-8ae549ed3428 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.749693 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 164/329] 10.222.0.46 () {56 vars in 1376 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/role_assignments?group.id=1f661b56ed2b4d8bb4bc6671b83bddc6&scope.project.id=a6a370bf40ca4f53b61878f62d5d2333&role.id=28346cbeb7e94e25b52f586669c5beaa => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:35.750457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848d33-a20a-46ef-a817-99bc8660c38e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.819502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:35.867238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848d33-a20a-46ef-a817-99bc8660c38e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:35.868310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4387d0-42e6-4095-95a0-8ae549ed3428 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:35.904933 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637c15a-6ca1-4de0-b8d5-18921a3fa80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:35.905583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637c15a-6ca1-4de0-b8d5-18921a3fa80e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:35.905860 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637c15a-6ca1-4de0-b8d5-18921a3fa80e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:35.906127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637c15a-6ca1-4de0-b8d5-18921a3fa80e None admin] PATH_INFO: `/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:35.907186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a446-3d42-4a98-9b70-3af77c33541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:35.907304 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637c15a-6ca1-4de0-b8d5-18921a3fa80e None admin] RBAC: Authorizing `identity:get_group(group_id=1f661b56ed2b4d8bb4bc6671b83bddc6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:35.907807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a446-3d42-4a98-9b70-3af77c33541b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:35.908075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a446-3d42-4a98-9b70-3af77c33541b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:35.908336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a446-3d42-4a98-9b70-3af77c33541b None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:35.908767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637c15a-6ca1-4de0-b8d5-18921a3fa80e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:35.909004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106a446-3d42-4a98-9b70-3af77c33541b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:35.909364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106a446-3d42-4a98-9b70-3af77c33541b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:35.910565 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 165/330] 10.222.0.46 () {56 vars in 1180 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/groups/1f661b56ed2b4d8bb4bc6671b83bddc6 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:35.911025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106a446-3d42-4a98-9b70-3af77c33541b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:35.916872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637c15a-6ca1-4de0-b8d5-18921a3fa80e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.921307 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 166/331] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:35.927437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a446-3d42-4a98-9b70-3af77c33541b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:35.957870 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:36.040468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637c15a-6ca1-4de0-b8d5-18921a3fa80e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:36.054186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a446-3d42-4a98-9b70-3af77c33541b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:36.074287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:36.081314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa8ec1-a4f5-480e-89fd-7eadfae78b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:36.081936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa8ec1-a4f5-480e-89fd-7eadfae78b9f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:36.082211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa8ec1-a4f5-480e-89fd-7eadfae78b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:36.082479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa8ec1-a4f5-480e-89fd-7eadfae78b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:36.083240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa8ec1-a4f5-480e-89fd-7eadfae78b9f None admin] RBAC: Adding query filter params (group.id=1f661b56ed2b4d8bb4bc6671b83bddc6, role.id=53001a60e154408cbe7ea6ad0f2d7e0f, scope.project.id=a6a370bf40ca4f53b61878f62d5d2333) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:36.084300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa8ec1-a4f5-480e-89fd-7eadfae78b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:36.085097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa8ec1-a4f5-480e-89fd-7eadfae78b9f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:36.091646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 166/332] 10.222.0.46 () {56 vars in 1376 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/role_assignments?group.id=1f661b56ed2b4d8bb4bc6671b83bddc6&scope.project.id=a6a370bf40ca4f53b61878f62d5d2333&role.id=53001a60e154408cbe7ea6ad0f2d7e0f => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:36.094962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84f04f-fa23-4835-9bba-be2b35b441f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:36.095583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84f04f-fa23-4835-9bba-be2b35b441f9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:36.095851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84f04f-fa23-4835-9bba-be2b35b441f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:36.096109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84f04f-fa23-4835-9bba-be2b35b441f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:36.175219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84f04f-fa23-4835-9bba-be2b35b441f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:36.176694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84f04f-fa23-4835-9bba-be2b35b441f9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:36.207175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:36.286102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 167/333] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:36.292408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa8ec1-a4f5-480e-89fd-7eadfae78b9f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:36.403945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa8ec1-a4f5-480e-89fd-7eadfae78b9f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:36.437470 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29563-767a-49df-a90e-584b35ab0414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:36.438110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29563-767a-49df-a90e-584b35ab0414 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:36.438391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29563-767a-49df-a90e-584b35ab0414 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:36.438656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29563-767a-49df-a90e-584b35ab0414 None admin] PATH_INFO: `/v3/projects/2412fb672dec485f9e4dda53e202b718` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:36.439863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc29563-767a-49df-a90e-584b35ab0414 None admin] RBAC: Authorizing `identity:get_project(project_id=2412fb672dec485f9e4dda53e202b718)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:36.441327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc29563-767a-49df-a90e-584b35ab0414 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:36.443033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 167/334] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:29:36 2022] GET /identity/v3/projects/2412fb672dec485f9e4dda53e202b718 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:36.449149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84f04f-fa23-4835-9bba-be2b35b441f9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:36.550708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84f04f-fa23-4835-9bba-be2b35b441f9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:36.577120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:36.588074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16520de1-1489-46db-829a-45ca5cc26714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:36.588703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16520de1-1489-46db-829a-45ca5cc26714 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:36.588983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16520de1-1489-46db-829a-45ca5cc26714 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:36.589255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16520de1-1489-46db-829a-45ca5cc26714 None admin] PATH_INFO: `/v3/groups/5c038e799e8441e6ad80bc6402da7102` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:36.590359 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16520de1-1489-46db-829a-45ca5cc26714 None admin] RBAC: Authorizing `identity:get_group(group_id=5c038e799e8441e6ad80bc6402da7102)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:36.591832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16520de1-1489-46db-829a-45ca5cc26714 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:36.593420 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 168/335] 10.222.0.46 () {56 vars in 1180 bytes} [Mon Oct 24 13:29:36 2022] GET /identity/v3/groups/5c038e799e8441e6ad80bc6402da7102 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:36.599760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29563-767a-49df-a90e-584b35ab0414 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:36.664896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:36.704831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29563-767a-49df-a90e-584b35ab0414 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:36.738853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac3e89-7672-4cfe-bcb7-d486d14c6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:36.739475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac3e89-7672-4cfe-bcb7-d486d14c6ffd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:36.739756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac3e89-7672-4cfe-bcb7-d486d14c6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:36.740016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac3e89-7672-4cfe-bcb7-d486d14c6ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:36.740736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac3e89-7672-4cfe-bcb7-d486d14c6ffd None admin] RBAC: Adding query filter params (group.id=5c038e799e8441e6ad80bc6402da7102, role.id=581091dd624142d3aad6710d1eb0affa, scope.project.id=2412fb672dec485f9e4dda53e202b718) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:36.741054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac3e89-7672-4cfe-bcb7-d486d14c6ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:36.742550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac3e89-7672-4cfe-bcb7-d486d14c6ffd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:36.748528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 168/336] 10.222.0.46 () {56 vars in 1376 bytes} [Mon Oct 24 13:29:36 2022] GET /identity/v3/role_assignments?group.id=5c038e799e8441e6ad80bc6402da7102&scope.project.id=2412fb672dec485f9e4dda53e202b718&role.id=581091dd624142d3aad6710d1eb0affa => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:39.323277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfe48-c5a6-4390-b8fb-870d1dc806a0 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:39.323815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfe48-c5a6-4390-b8fb-870d1dc806a0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:39.323815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfe48-c5a6-4390-b8fb-870d1dc806a0 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:39.325198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 169/337] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:39.343937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6544f-58e0-4528-a99b-c6dcf76f7115 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:39.344445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6544f-58e0-4528-a99b-c6dcf76f7115 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:39.344445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6544f-58e0-4528-a99b-c6dcf76f7115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:39.366613 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b0a6544f-58e0-4528-a99b-c6dcf76f7115 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:39.367823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b0a6544f-58e0-4528-a99b-c6dcf76f7115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:39.422877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebb525-398d-4a1a-add7-5415e4e748d3 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:39.423798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebb525-398d-4a1a-add7-5415e4e748d3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:39.424277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebb525-398d-4a1a-add7-5415e4e748d3 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:39.425832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 170/338] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:29:39.432516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6126-6743-4288-8408-c9fbfb7cb2ab None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:39.437304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6126-6743-4288-8408-c9fbfb7cb2ab None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:39.437796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6126-6743-4288-8408-c9fbfb7cb2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:39.471427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ea2f6126-6743-4288-8408-c9fbfb7cb2ab None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:39.473146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ea2f6126-6743-4288-8408-c9fbfb7cb2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:39.489480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 169/339] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:39.581886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 171/340] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:39.829258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6544f-58e0-4528-a99b-c6dcf76f7115 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:39.894539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:39.922474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6126-6743-4288-8408-c9fbfb7cb2ab None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:39.950908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6544f-58e0-4528-a99b-c6dcf76f7115 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:39.999753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5fe38-8723-4a98-a33a-3a80779fdcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:40.000682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5fe38-8723-4a98-a33a-3a80779fdcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.000958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5fe38-8723-4a98-a33a-3a80779fdcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.001225 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5fe38-8723-4a98-a33a-3a80779fdcc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.016487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5fe38-8723-4a98-a33a-3a80779fdcc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:40.017956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5fe38-8723-4a98-a33a-3a80779fdcc3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-5cf5fe38-8723-4a98-a33a-3a80779fdcc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:40.041391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:40.042384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:40.043278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:40.043278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:40.043278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:40.043949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 170/341] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:40.045305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3def5-5237-44f2-b697-90e2075dda54 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.045582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3def5-5237-44f2-b697-90e2075dda54 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.045851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3def5-5237-44f2-b697-90e2075dda54 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.046210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6126-6743-4288-8408-c9fbfb7cb2ab None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:40.047427 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 171/342] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:40.052553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431473-c866-43bc-af07-782f2dcb4c7c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.052962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431473-c866-43bc-af07-782f2dcb4c7c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.053363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431473-c866-43bc-af07-782f2dcb4c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.074103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e3431473-c866-43bc-af07-782f2dcb4c7c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:40.074293 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:40.075617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e3431473-c866-43bc-af07-782f2dcb4c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:40.085934 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64b4fd-1293-4f2a-86f8-e710794925ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:40.086569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b4fd-1293-4f2a-86f8-e710794925ff None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.086837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b4fd-1293-4f2a-86f8-e710794925ff None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.087126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b4fd-1293-4f2a-86f8-e710794925ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.099029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64b4fd-1293-4f2a-86f8-e710794925ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:40.100541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64b4fd-1293-4f2a-86f8-e710794925ff None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-9b64b4fd-1293-4f2a-86f8-e710794925ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:40.119439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:40.120360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:40.121207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:40.121207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:40.121207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:40.121207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 172/343] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:40.121850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64b4fd-1293-4f2a-86f8-e710794925ff None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:40.151014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 172/344] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:40.152706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323012-355e-4061-9211-83532dd444a2 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.152996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323012-355e-4061-9211-83532dd444a2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.153263 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323012-355e-4061-9211-83532dd444a2 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.154505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 173/345] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:40.155280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323012-355e-4061-9211-83532dd444a2 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:40.218162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:40.243826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64b4fd-1293-4f2a-86f8-e710794925ff None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:40.291152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ffa4-4ee4-42d1-88fe-92b8350b3c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:40.291549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323012-355e-4061-9211-83532dd444a2 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:40.292340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ffa4-4ee4-42d1-88fe-92b8350b3c2b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.292861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ffa4-4ee4-42d1-88fe-92b8350b3c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.293494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ffa4-4ee4-42d1-88fe-92b8350b3c2b None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.295273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29ffa4-4ee4-42d1-88fe-92b8350b3c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:40.295761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29ffa4-4ee4-42d1-88fe-92b8350b3c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:40.297309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29ffa4-4ee4-42d1-88fe-92b8350b3c2b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:40.312190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 173/346] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:40.314180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1707bc-8559-41e3-98a2-064c648d59e6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.314900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1707bc-8559-41e3-98a2-064c648d59e6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.315364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1707bc-8559-41e3-98a2-064c648d59e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.329140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74b3b8-58a1-4133-aac8-d2c55257df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:40.330068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74b3b8-58a1-4133-aac8-d2c55257df4f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.330176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74b3b8-58a1-4133-aac8-d2c55257df4f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.330524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74b3b8-58a1-4133-aac8-d2c55257df4f None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.331412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74b3b8-58a1-4133-aac8-d2c55257df4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:40.331779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74b3b8-58a1-4133-aac8-d2c55257df4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:40.333894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74b3b8-58a1-4133-aac8-d2c55257df4f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:40.337665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ba1707bc-8559-41e3-98a2-064c648d59e6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:40.339477 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ba1707bc-8559-41e3-98a2-064c648d59e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:40.352059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 174/347] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:40.353292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74b3b8-58a1-4133-aac8-d2c55257df4f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:40.373317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:40.419450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 174/348] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:40.420396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1707bc-8559-41e3-98a2-064c648d59e6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:40.464096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:40.470890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74b3b8-58a1-4133-aac8-d2c55257df4f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:40.518869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909cf63-566c-409d-991c-ec48888f1679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:40.519407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909cf63-566c-409d-991c-ec48888f1679 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.519689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909cf63-566c-409d-991c-ec48888f1679 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.519959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909cf63-566c-409d-991c-ec48888f1679 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.520669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909cf63-566c-409d-991c-ec48888f1679 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:40.522996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909cf63-566c-409d-991c-ec48888f1679 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:40.542887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1707bc-8559-41e3-98a2-064c648d59e6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:40.549638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 175/349] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:40 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:40.550798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909cf63-566c-409d-991c-ec48888f1679 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:40.601119 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc9ad0-e47c-4169-9c47-8005ee358cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:40.602125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc9ad0-e47c-4169-9c47-8005ee358cfd None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.603461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc9ad0-e47c-4169-9c47-8005ee358cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.604212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc9ad0-e47c-4169-9c47-8005ee358cfd None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.605862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc9ad0-e47c-4169-9c47-8005ee358cfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:40.607752 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc9ad0-e47c-4169-9c47-8005ee358cfd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:40.664180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 175/350] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:40 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:40.717659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc9ad0-e47c-4169-9c47-8005ee358cfd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:40.750030 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909cf63-566c-409d-991c-ec48888f1679 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:40.750232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:40.827541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4969c7-8de7-4b0d-96b2-0d407f592b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:40.828199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4969c7-8de7-4b0d-96b2-0d407f592b81 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.828469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4969c7-8de7-4b0d-96b2-0d407f592b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.828823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4969c7-8de7-4b0d-96b2-0d407f592b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.845391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4969c7-8de7-4b0d-96b2-0d407f592b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:40.846899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4969c7-8de7-4b0d-96b2-0d407f592b81 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-4a4969c7-8de7-4b0d-96b2-0d407f592b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:40.865969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:40.867197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:40.868057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:40.868057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:40.868057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:40.868057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 176/351] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:40.873689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4969c7-8de7-4b0d-96b2-0d407f592b81 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:40.886005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:40.889053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc9ad0-e47c-4169-9c47-8005ee358cfd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:40.938584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3200a65-7322-4bbb-b019-c3e32bb05ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:40.939609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3200a65-7322-4bbb-b019-c3e32bb05ceb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:40.940100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3200a65-7322-4bbb-b019-c3e32bb05ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:40.941005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3200a65-7322-4bbb-b019-c3e32bb05ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:40.956829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3200a65-7322-4bbb-b019-c3e32bb05ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:40.959378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3200a65-7322-4bbb-b019-c3e32bb05ceb None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d3200a65-7322-4bbb-b019-c3e32bb05ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:40.979168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:40.980132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:40.980967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:40.980967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:40.980967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:40.983846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 176/352] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:29:40.991395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3200a65-7322-4bbb-b019-c3e32bb05ceb None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:41.005034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4969c7-8de7-4b0d-96b2-0d407f592b81 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:41.043424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a1196-8182-49cc-8219-24aa3537fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:41.044037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a1196-8182-49cc-8219-24aa3537fad3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:41.044310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a1196-8182-49cc-8219-24aa3537fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:41.044577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a1196-8182-49cc-8219-24aa3537fad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:41.045218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a1196-8182-49cc-8219-24aa3537fad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:41.045514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a1196-8182-49cc-8219-24aa3537fad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:41.046893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a1196-8182-49cc-8219-24aa3537fad3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:41.060715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 177/353] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:41.066006 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a1196-8182-49cc-8219-24aa3537fad3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:41.097263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:41.136611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3200a65-7322-4bbb-b019-c3e32bb05ceb None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:41.142982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:41.179247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c021a97-5f0f-4f4a-98f5-eff857a3c414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:41.179845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a1196-8182-49cc-8219-24aa3537fad3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:41.180380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c021a97-5f0f-4f4a-98f5-eff857a3c414 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:41.180842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c021a97-5f0f-4f4a-98f5-eff857a3c414 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:41.181282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c021a97-5f0f-4f4a-98f5-eff857a3c414 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:41.183173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c021a97-5f0f-4f4a-98f5-eff857a3c414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:41.183387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c021a97-5f0f-4f4a-98f5-eff857a3c414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:41.184787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c021a97-5f0f-4f4a-98f5-eff857a3c414 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:41.200413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 177/354] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:41.205305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c520a8f-a32c-49bb-a04e-ed4cd5064a98 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:41.205305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c520a8f-a32c-49bb-a04e-ed4cd5064a98 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:41.205305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c520a8f-a32c-49bb-a04e-ed4cd5064a98 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:41.206329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 178/355] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:41.206887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c520a8f-a32c-49bb-a04e-ed4cd5064a98 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:41.232543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74385ccf-f5c7-4e1e-8de9-e1529a2f71ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:41.233868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74385ccf-f5c7-4e1e-8de9-e1529a2f71ea None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:41.234332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74385ccf-f5c7-4e1e-8de9-e1529a2f71ea None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:41.234786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74385ccf-f5c7-4e1e-8de9-e1529a2f71ea None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:41.235633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74385ccf-f5c7-4e1e-8de9-e1529a2f71ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:41.238101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74385ccf-f5c7-4e1e-8de9-e1529a2f71ea None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:41.265193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 178/356] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:41 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:29:41.266560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f03c50-575c-4f23-a465-90beed99157f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:41.266845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f03c50-575c-4f23-a465-90beed99157f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:41.267171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f03c50-575c-4f23-a465-90beed99157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:41.288694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-52f03c50-575c-4f23-a465-90beed99157f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:41.290058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-52f03c50-575c-4f23-a465-90beed99157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:41.339821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c520a8f-a32c-49bb-a04e-ed4cd5064a98 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:41.394588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104481b-bae8-4b67-a2bb-6ef29dbcdcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:41.398759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104481b-bae8-4b67-a2bb-6ef29dbcdcde None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:41.400132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104481b-bae8-4b67-a2bb-6ef29dbcdcde None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:41.400592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104481b-bae8-4b67-a2bb-6ef29dbcdcde None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:41.401599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104481b-bae8-4b67-a2bb-6ef29dbcdcde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:41.405279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104481b-bae8-4b67-a2bb-6ef29dbcdcde None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:41.421899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:41.458956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 179/358] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:41.459589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 179/358] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:41 2022] POST /identity/v3/users => generated 249 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:41.738019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104481b-bae8-4b67-a2bb-6ef29dbcdcde None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:41.856790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104481b-bae8-4b67-a2bb-6ef29dbcdcde None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:41.911079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:41.911714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:41.912048 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:41.912318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:41.913141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:41.914512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:41.928267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.sql.core [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 13:29:41.928267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 13:29:41.928267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [parameters: {'id': '601fe0d5480c4df79241533cb9652cd6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 13:29:41.928267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81762) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result.read() Oct 24 13:29:41.935737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return ref.to_dict() Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:29:41.936567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application yield resource Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise self.value Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application session.commit() Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:29:41.937462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:29:41.938274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:29:41.939896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result.read() Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:29:41.940696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [parameters: {'id': '601fe0d5480c4df79241533cb9652cd6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:41.941565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 13:29:41.944008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:41.946040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 180/359] 10.222.0.46 () {60 vars in 1131 bytes} [Mon Oct 24 13:29:41 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:41.946169 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f03c50-575c-4f23-a465-90beed99157f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:42.008134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:42.060380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f03c50-575c-4f23-a465-90beed99157f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:42.113456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920ce19-d7cb-4604-aab3-b03830d25098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:42.114101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920ce19-d7cb-4604-aab3-b03830d25098 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:42.114375 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920ce19-d7cb-4604-aab3-b03830d25098 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:42.114641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920ce19-d7cb-4604-aab3-b03830d25098 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:42.132756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920ce19-d7cb-4604-aab3-b03830d25098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-5920ce19-d7cb-4604-aab3-b03830d25098 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:42.137734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:42.138692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:29:42.139505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:42.140094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 180/360] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:29:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:42.144877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:42.217179 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:42.265816 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef360e0-7ad2-4ff0-a284-b7620da6c371 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:42.301259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99e4d8-019e-424f-afe8-8d4fa0b584a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:42.301925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e4d8-019e-424f-afe8-8d4fa0b584a7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:42.302204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e4d8-019e-424f-afe8-8d4fa0b584a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:42.302518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e4d8-019e-424f-afe8-8d4fa0b584a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:42.303326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e4d8-019e-424f-afe8-8d4fa0b584a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:42.303622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e4d8-019e-424f-afe8-8d4fa0b584a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:42.305079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e4d8-019e-424f-afe8-8d4fa0b584a7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:42.313965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 181/361] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:43.294319 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8f9d-9285-4eb7-b1c5-a8bba900b4ac None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:43.294850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8f9d-9285-4eb7-b1c5-a8bba900b4ac None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:43.294850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8f9d-9285-4eb7-b1c5-a8bba900b4ac None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:43.296389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 181/362] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:43.301481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4ab94-27a0-4c67-84a5-7e6479887c4b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:43.301867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4ab94-27a0-4c67-84a5-7e6479887c4b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:43.302025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4ab94-27a0-4c67-84a5-7e6479887c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:43.321322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d0c4ab94-27a0-4c67-84a5-7e6479887c4b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:43.322594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d0c4ab94-27a0-4c67-84a5-7e6479887c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:43.374362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644b211-0d5c-4620-88f0-69ff1c5aae65 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:43.374647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644b211-0d5c-4620-88f0-69ff1c5aae65 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:43.374955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644b211-0d5c-4620-88f0-69ff1c5aae65 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:43.376876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 182/363] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:43.391135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee373fa-842c-49ff-8edc-010c658f4116 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:43.391420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee373fa-842c-49ff-8edc-010c658f4116 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:43.391695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee373fa-842c-49ff-8edc-010c658f4116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:43.410038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7ee373fa-842c-49ff-8edc-010c658f4116 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:43.411267 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7ee373fa-842c-49ff-8edc-010c658f4116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:43.436213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 182/364] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:43.502671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 183/365] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:43.789337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4ab94-27a0-4c67-84a5-7e6479887c4b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:43.800677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee373fa-842c-49ff-8edc-010c658f4116 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:43.873498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:43.893101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:43.974531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4ab94-27a0-4c67-84a5-7e6479887c4b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:43.994747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee373fa-842c-49ff-8edc-010c658f4116 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:44.045711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203feee-c016-49b4-9066-2bfa9246e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:44.046273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203feee-c016-49b4-9066-2bfa9246e256 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.046547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203feee-c016-49b4-9066-2bfa9246e256 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.047102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203feee-c016-49b4-9066-2bfa9246e256 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.052126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebd0e3-e658-491d-9ef7-3d13daacb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:44.052774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebd0e3-e658-491d-9ef7-3d13daacb4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.053150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebd0e3-e658-491d-9ef7-3d13daacb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.053461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebd0e3-e658-491d-9ef7-3d13daacb4f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.065810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebd0e3-e658-491d-9ef7-3d13daacb4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-32ebd0e3-e658-491d-9ef7-3d13daacb4f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:44.071062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:44.071922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:44.072749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:44.073361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 184/366] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:44.076292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203feee-c016-49b4-9066-2bfa9246e256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:44.080741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebd0e3-e658-491d-9ef7-3d13daacb4f6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f203feee-c016-49b4-9066-2bfa9246e256 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:44.082781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:44.083666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:44.084714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:44.086968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 183/367] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:44.098226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203feee-c016-49b4-9066-2bfa9246e256 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:44.243046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203feee-c016-49b4-9066-2bfa9246e256 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:44.250822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:44.260026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebd0e3-e658-491d-9ef7-3d13daacb4f6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:44.262426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:44.282734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969579c-57cb-4b1c-a4e3-6eb66c098283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:44.283374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969579c-57cb-4b1c-a4e3-6eb66c098283 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.283772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969579c-57cb-4b1c-a4e3-6eb66c098283 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.284046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969579c-57cb-4b1c-a4e3-6eb66c098283 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.284713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969579c-57cb-4b1c-a4e3-6eb66c098283 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:44.285011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969579c-57cb-4b1c-a4e3-6eb66c098283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:44.286429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969579c-57cb-4b1c-a4e3-6eb66c098283 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:44.296105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 184/368] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:44.299679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fcefd-b1f6-4a78-b6ba-7e9d5718614a None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.299960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fcefd-b1f6-4a78-b6ba-7e9d5718614a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.300232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fcefd-b1f6-4a78-b6ba-7e9d5718614a None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.301679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 185/369] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:44.302800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe963d-6409-457c-9e6a-4fbaeef5a201 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.303232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe963d-6409-457c-9e6a-4fbaeef5a201 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.303494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe963d-6409-457c-9e6a-4fbaeef5a201 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.303906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9e5f5-fcb8-469b-916f-b4218add2963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:44.304636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9e5f5-fcb8-469b-916f-b4218add2963 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.305008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9e5f5-fcb8-469b-916f-b4218add2963 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.305375 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9e5f5-fcb8-469b-916f-b4218add2963 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.305765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 186/370] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:44.306519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9e5f5-fcb8-469b-916f-b4218add2963 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:44.306634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe963d-6409-457c-9e6a-4fbaeef5a201 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:44.306828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9e5f5-fcb8-469b-916f-b4218add2963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:44.308333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9e5f5-fcb8-469b-916f-b4218add2963 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:44.318417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 185/371] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:44.319713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1de992-f156-448c-9cf1-e8378efa7c9f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.320246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1de992-f156-448c-9cf1-e8378efa7c9f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.320581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1de992-f156-448c-9cf1-e8378efa7c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.339353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fd1de992-f156-448c-9cf1-e8378efa7c9f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:44.340778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fd1de992-f156-448c-9cf1-e8378efa7c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:44.415114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 186/372] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:44.416358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a02c7-6044-4f5c-a5a6-8b4f9a285cf8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.416636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a02c7-6044-4f5c-a5a6-8b4f9a285cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.417086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a02c7-6044-4f5c-a5a6-8b4f9a285cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.427214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe963d-6409-457c-9e6a-4fbaeef5a201 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:44.439847 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3e9a02c7-6044-4f5c-a5a6-8b4f9a285cf8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:44.440943 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3e9a02c7-6044-4f5c-a5a6-8b4f9a285cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:44.467089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6475dc-6412-438c-8dc8-6c79165b33db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:44.468031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6475dc-6412-438c-8dc8-6c79165b33db None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.468721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6475dc-6412-438c-8dc8-6c79165b33db None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.469176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6475dc-6412-438c-8dc8-6c79165b33db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.483328 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6475dc-6412-438c-8dc8-6c79165b33db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:44.484815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6475dc-6412-438c-8dc8-6c79165b33db None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-7b6475dc-6412-438c-8dc8-6c79165b33db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:44.501698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:44.502725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:44.503604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:44.503604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:44.503604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:44.503604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 187/373] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:44.504313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6475dc-6412-438c-8dc8-6c79165b33db None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:44.525678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 187/374] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:44.531153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a02c7-6044-4f5c-a5a6-8b4f9a285cf8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:44.538651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:44.585896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:44.693704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6475dc-6412-438c-8dc8-6c79165b33db None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:44.709672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a02c7-6044-4f5c-a5a6-8b4f9a285cf8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:44.737993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca8a0-0210-45a3-934b-c5ed09cba80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:44.738644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca8a0-0210-45a3-934b-c5ed09cba80e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.738935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca8a0-0210-45a3-934b-c5ed09cba80e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.739214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca8a0-0210-45a3-934b-c5ed09cba80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.751169 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f77a87-eb85-4079-9433-08555ba0c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:44.751719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdca8a0-0210-45a3-934b-c5ed09cba80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:44.752139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f77a87-eb85-4079-9433-08555ba0c193 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.752591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f77a87-eb85-4079-9433-08555ba0c193 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.752988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f77a87-eb85-4079-9433-08555ba0c193 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.753179 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdca8a0-0210-45a3-934b-c5ed09cba80e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:44.753936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f77a87-eb85-4079-9433-08555ba0c193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:44.754413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f77a87-eb85-4079-9433-08555ba0c193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:44.755931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f77a87-eb85-4079-9433-08555ba0c193 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:44.768275 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 188/375] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:44.769318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f77a87-eb85-4079-9433-08555ba0c193 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-5cdca8a0-0210-45a3-934b-c5ed09cba80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:44.771499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:44.772818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:44.773835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:44.773835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:44.773835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:44.776506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 188/376] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:44.781318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca8a0-0210-45a3-934b-c5ed09cba80e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:44.858552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:44.866292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:44.882287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f77a87-eb85-4079-9433-08555ba0c193 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:44.893549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca8a0-0210-45a3-934b-c5ed09cba80e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:44.918227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43146080-76c7-4562-90b6-c1f6c0297e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:44.918866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43146080-76c7-4562-90b6-c1f6c0297e2d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.919174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43146080-76c7-4562-90b6-c1f6c0297e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.919449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43146080-76c7-4562-90b6-c1f6c0297e2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.929872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43146080-76c7-4562-90b6-c1f6c0297e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:44.931994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfd15-3afe-4d9d-bb13-e80a22dcf58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:44.932640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfd15-3afe-4d9d-bb13-e80a22dcf58e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:44.932913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfd15-3afe-4d9d-bb13-e80a22dcf58e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:44.933177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfd15-3afe-4d9d-bb13-e80a22dcf58e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-43146080-76c7-4562-90b6-c1f6c0297e2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:44.935328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:44.936171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:44.936967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 189/377] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:44.937620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43146080-76c7-4562-90b6-c1f6c0297e2d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:44.946960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacfd15-3afe-4d9d-bb13-e80a22dcf58e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:44.948406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacfd15-3afe-4d9d-bb13-e80a22dcf58e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-1bacfd15-3afe-4d9d-bb13-e80a22dcf58e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:44.963419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:44.964378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:44.965250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 189/378] 10.222.0.46 () {56 vars in 1093 bytes} [Mon Oct 24 13:29:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:44.965843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfd15-3afe-4d9d-bb13-e80a22dcf58e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.050147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43146080-76c7-4562-90b6-c1f6c0297e2d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.073905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfd15-3afe-4d9d-bb13-e80a22dcf58e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.086388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0341c2a-6ccb-498d-bf0a-a0154c296f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.087032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0341c2a-6ccb-498d-bf0a-a0154c296f2f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.087312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0341c2a-6ccb-498d-bf0a-a0154c296f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.087578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0341c2a-6ccb-498d-bf0a-a0154c296f2f None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.088222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0341c2a-6ccb-498d-bf0a-a0154c296f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:45.088516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0341c2a-6ccb-498d-bf0a-a0154c296f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.089972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0341c2a-6ccb-498d-bf0a-a0154c296f2f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.102524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 190/379] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:45.103376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0341c2a-6ccb-498d-bf0a-a0154c296f2f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.107570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea4558-f79f-4d1f-9087-6cb847f021fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.108340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:45.109092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea4558-f79f-4d1f-9087-6cb847f021fc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.109248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea4558-f79f-4d1f-9087-6cb847f021fc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.109510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea4558-f79f-4d1f-9087-6cb847f021fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.112247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:45.120898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea4558-f79f-4d1f-9087-6cb847f021fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d5ea4558-f79f-4d1f-9087-6cb847f021fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:45.126273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:45.127388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 190/380] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:45.128271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea4558-f79f-4d1f-9087-6cb847f021fc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.209572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0341c2a-6ccb-498d-bf0a-a0154c296f2f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.229370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea4558-f79f-4d1f-9087-6cb847f021fc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.245106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39498ff7-8cee-4468-a709-99e0f7138b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.245712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498ff7-8cee-4468-a709-99e0f7138b31 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.245980 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498ff7-8cee-4468-a709-99e0f7138b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.246249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498ff7-8cee-4468-a709-99e0f7138b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.246898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39498ff7-8cee-4468-a709-99e0f7138b31 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:45.247224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39498ff7-8cee-4468-a709-99e0f7138b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.248607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39498ff7-8cee-4468-a709-99e0f7138b31 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.256622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 191/381] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:45.257783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea0cd7-7ba0-4666-9e71-388c2f5d1197 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.258111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea0cd7-7ba0-4666-9e71-388c2f5d1197 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.258382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea0cd7-7ba0-4666-9e71-388c2f5d1197 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.259869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 192/382] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:45.260558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea0cd7-7ba0-4666-9e71-388c2f5d1197 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.266647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82526b7d-4c72-4d1b-826a-34ecac9743a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.267280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82526b7d-4c72-4d1b-826a-34ecac9743a3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.267550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82526b7d-4c72-4d1b-826a-34ecac9743a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.267813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82526b7d-4c72-4d1b-826a-34ecac9743a3 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.268540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82526b7d-4c72-4d1b-826a-34ecac9743a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:45.268840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82526b7d-4c72-4d1b-826a-34ecac9743a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.270268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82526b7d-4c72-4d1b-826a-34ecac9743a3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.307058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 191/383] 10.222.0.46 () {56 vars in 1133 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:45.307895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82526b7d-4c72-4d1b-826a-34ecac9743a3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.331178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:45.359388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:45.366862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea0cd7-7ba0-4666-9e71-388c2f5d1197 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.404625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf50524-c1ed-4f73-8e74-eb5683659032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.405253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf50524-c1ed-4f73-8e74-eb5683659032 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.405524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf50524-c1ed-4f73-8e74-eb5683659032 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.405788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf50524-c1ed-4f73-8e74-eb5683659032 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.410116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82526b7d-4c72-4d1b-826a-34ecac9743a3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.413290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf50524-c1ed-4f73-8e74-eb5683659032 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.414730 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf50524-c1ed-4f73-8e74-eb5683659032 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-daf50524-c1ed-4f73-8e74-eb5683659032 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:45.427125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:45.428163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 193/384] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:45.429153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf50524-c1ed-4f73-8e74-eb5683659032 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.445469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e7fde-4d62-442e-8ad5-69a6ce95b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.446176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e7fde-4d62-442e-8ad5-69a6ce95b554 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.446491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e7fde-4d62-442e-8ad5-69a6ce95b554 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.446795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e7fde-4d62-442e-8ad5-69a6ce95b554 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.447538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e7fde-4d62-442e-8ad5-69a6ce95b554 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:45.447986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e7fde-4d62-442e-8ad5-69a6ce95b554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.449509 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e7fde-4d62-442e-8ad5-69a6ce95b554 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.458139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 192/385] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:45.459564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1b61c-0d8a-4cf0-97b7-48aa41fe4f80 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.459894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1b61c-0d8a-4cf0-97b7-48aa41fe4f80 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.460163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1b61c-0d8a-4cf0-97b7-48aa41fe4f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.478271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-00b1b61c-0d8a-4cf0-97b7-48aa41fe4f80 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:45.479524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-00b1b61c-0d8a-4cf0-97b7-48aa41fe4f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:45.533176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf50524-c1ed-4f73-8e74-eb5683659032 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.548146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 193/386] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:45.548986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1b61c-0d8a-4cf0-97b7-48aa41fe4f80 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.574207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:45.586421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd57bf-3ec7-4ac0-b2b6-798599fe22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.587326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd57bf-3ec7-4ac0-b2b6-798599fe22bc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.587776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd57bf-3ec7-4ac0-b2b6-798599fe22bc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.588238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd57bf-3ec7-4ac0-b2b6-798599fe22bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.593479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:45.600591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd57bf-3ec7-4ac0-b2b6-798599fe22bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.602270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd57bf-3ec7-4ac0-b2b6-798599fe22bc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2cdd57bf-3ec7-4ac0-b2b6-798599fe22bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:45.616963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:45.618039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:45.618998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:45.618998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:45.618998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:45.620371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 194/387] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:45.621289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd57bf-3ec7-4ac0-b2b6-798599fe22bc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.659178 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1b61c-0d8a-4cf0-97b7-48aa41fe4f80 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.695736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96426b6f-4bae-410a-95ed-6b0fc80b32f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.696513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96426b6f-4bae-410a-95ed-6b0fc80b32f3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.697487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96426b6f-4bae-410a-95ed-6b0fc80b32f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.697487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96426b6f-4bae-410a-95ed-6b0fc80b32f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.707152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96426b6f-4bae-410a-95ed-6b0fc80b32f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.708596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96426b6f-4bae-410a-95ed-6b0fc80b32f3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-96426b6f-4bae-410a-95ed-6b0fc80b32f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:45.723190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:45.724109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:45.725209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:45.725209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:45.725209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:45.725209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 194/388] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:45.725209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96426b6f-4bae-410a-95ed-6b0fc80b32f3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.735132 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd57bf-3ec7-4ac0-b2b6-798599fe22bc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.769248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567eb7f-1c83-4ae3-9dae-3062be4b2486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.769859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567eb7f-1c83-4ae3-9dae-3062be4b2486 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.770139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567eb7f-1c83-4ae3-9dae-3062be4b2486 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.770408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567eb7f-1c83-4ae3-9dae-3062be4b2486 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.771157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567eb7f-1c83-4ae3-9dae-3062be4b2486 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:45.771458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567eb7f-1c83-4ae3-9dae-3062be4b2486 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.773067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567eb7f-1c83-4ae3-9dae-3062be4b2486 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.811030 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 195/389] 10.222.0.46 () {56 vars in 1137 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:45.811909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567eb7f-1c83-4ae3-9dae-3062be4b2486 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.828942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:45.835556 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96426b6f-4bae-410a-95ed-6b0fc80b32f3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.853376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:45.869214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696d714-63ea-4be0-abd7-34e6f41c6cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.869758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696d714-63ea-4be0-abd7-34e6f41c6cfa None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.870017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696d714-63ea-4be0-abd7-34e6f41c6cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.870286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696d714-63ea-4be0-abd7-34e6f41c6cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.881562 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696d714-63ea-4be0-abd7-34e6f41c6cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.883074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696d714-63ea-4be0-abd7-34e6f41c6cfa None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-5696d714-63ea-4be0-abd7-34e6f41c6cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:45.897435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:45.898559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:45.899646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:45.899646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:45.899646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:45.899646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 195/390] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:45.899646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696d714-63ea-4be0-abd7-34e6f41c6cfa None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:45.915996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567eb7f-1c83-4ae3-9dae-3062be4b2486 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:45.950814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4a5c-59f9-4875-9325-0087e30a9472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:45.951456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4a5c-59f9-4875-9325-0087e30a9472 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:45.951734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4a5c-59f9-4875-9325-0087e30a9472 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:45.952005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4a5c-59f9-4875-9325-0087e30a9472 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:45.952643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb4a5c-59f9-4875-9325-0087e30a9472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:45.952943 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb4a5c-59f9-4875-9325-0087e30a9472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:45.954346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb4a5c-59f9-4875-9325-0087e30a9472 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:45.965654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 196/391] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:45.970445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4a5c-59f9-4875-9325-0087e30a9472 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.000849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696d714-63ea-4be0-abd7-34e6f41c6cfa None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.034753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713b8b-daa4-488f-bcfb-08681d09d647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.035287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713b8b-daa4-488f-bcfb-08681d09d647 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.036206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713b8b-daa4-488f-bcfb-08681d09d647 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.036206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713b8b-daa4-488f-bcfb-08681d09d647 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.036452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34713b8b-daa4-488f-bcfb-08681d09d647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:46.036749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34713b8b-daa4-488f-bcfb-08681d09d647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.038206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34713b8b-daa4-488f-bcfb-08681d09d647 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.049963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 196/392] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:46.050763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713b8b-daa4-488f-bcfb-08681d09d647 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.060858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:46.063797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:46.067671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4a5c-59f9-4875-9325-0087e30a9472 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.102498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619fcb2-3da0-47aa-8d8d-93987e9df510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.103168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619fcb2-3da0-47aa-8d8d-93987e9df510 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.103445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619fcb2-3da0-47aa-8d8d-93987e9df510 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.103709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619fcb2-3da0-47aa-8d8d-93987e9df510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.113946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619fcb2-3da0-47aa-8d8d-93987e9df510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.115504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619fcb2-3da0-47aa-8d8d-93987e9df510 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b619fcb2-3da0-47aa-8d8d-93987e9df510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:46.129617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:46.130735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:46.131962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:46.131962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:46.131962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:46.131962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 197/393] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:46.131962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619fcb2-3da0-47aa-8d8d-93987e9df510 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.155963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713b8b-daa4-488f-bcfb-08681d09d647 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.190056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf0fbe-ad63-4666-bac1-66c933a1aa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.190688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf0fbe-ad63-4666-bac1-66c933a1aa50 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.190983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf0fbe-ad63-4666-bac1-66c933a1aa50 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.191255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf0fbe-ad63-4666-bac1-66c933a1aa50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.201435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf0fbe-ad63-4666-bac1-66c933a1aa50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.202905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf0fbe-ad63-4666-bac1-66c933a1aa50 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-cbcf0fbe-ad63-4666-bac1-66c933a1aa50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:46.217363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:46.218361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:46.219342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:46.219342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:46.219342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:46.219342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 197/394] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:46.219342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf0fbe-ad63-4666-bac1-66c933a1aa50 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.232217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619fcb2-3da0-47aa-8d8d-93987e9df510 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.267354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a8d3-8963-4e04-9115-ce4f850784a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.267970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a8d3-8963-4e04-9115-ce4f850784a6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.268245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a8d3-8963-4e04-9115-ce4f850784a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.268515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a8d3-8963-4e04-9115-ce4f850784a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.269153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a8d3-8963-4e04-9115-ce4f850784a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:46.269456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a8d3-8963-4e04-9115-ce4f850784a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.270857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a8d3-8963-4e04-9115-ce4f850784a6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.278835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:46.283425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 198/395] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:46.284234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a8d3-8963-4e04-9115-ce4f850784a6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.298431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:46.321461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf0fbe-ad63-4666-bac1-66c933a1aa50 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.354075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32512e8c-8c2d-4cd5-b24f-29157affdf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.354706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32512e8c-8c2d-4cd5-b24f-29157affdf89 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.355011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32512e8c-8c2d-4cd5-b24f-29157affdf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.355287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32512e8c-8c2d-4cd5-b24f-29157affdf89 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.362832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32512e8c-8c2d-4cd5-b24f-29157affdf89 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.364320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32512e8c-8c2d-4cd5-b24f-29157affdf89 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-32512e8c-8c2d-4cd5-b24f-29157affdf89 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:46.375936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:46.376942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:46.377899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 198/396] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:46.378719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32512e8c-8c2d-4cd5-b24f-29157affdf89 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.392113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a8d3-8963-4e04-9115-ce4f850784a6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.426514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90287a-80e7-4c57-b97c-5991a14c6bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.427254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90287a-80e7-4c57-b97c-5991a14c6bcc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.427537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90287a-80e7-4c57-b97c-5991a14c6bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.427817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90287a-80e7-4c57-b97c-5991a14c6bcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.434507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90287a-80e7-4c57-b97c-5991a14c6bcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.436024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90287a-80e7-4c57-b97c-5991a14c6bcc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0d90287a-80e7-4c57-b97c-5991a14c6bcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:46.447983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:46.448830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:46.449715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:46.449715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:46.449715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:46.449715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:46.449715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:46.449715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:46.449715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:46.449715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:46.449715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 199/397] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:46.450170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90287a-80e7-4c57-b97c-5991a14c6bcc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.485539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32512e8c-8c2d-4cd5-b24f-29157affdf89 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.502046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:46.519509 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25df3c3-ef36-4f14-8d42-39e39d88e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.520103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25df3c3-ef36-4f14-8d42-39e39d88e03c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.520370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25df3c3-ef36-4f14-8d42-39e39d88e03c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.520745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25df3c3-ef36-4f14-8d42-39e39d88e03c None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.520947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:46.521268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25df3c3-ef36-4f14-8d42-39e39d88e03c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:46.521619 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25df3c3-ef36-4f14-8d42-39e39d88e03c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.523219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25df3c3-ef36-4f14-8d42-39e39d88e03c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.535513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 199/398] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:46.539922 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25df3c3-ef36-4f14-8d42-39e39d88e03c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.554115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90287a-80e7-4c57-b97c-5991a14c6bcc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.588341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cec9b6-8f3c-4202-ab0c-f4591665e764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.588951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cec9b6-8f3c-4202-ab0c-f4591665e764 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.589228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cec9b6-8f3c-4202-ab0c-f4591665e764 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.589496 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cec9b6-8f3c-4202-ab0c-f4591665e764 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.590130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cec9b6-8f3c-4202-ab0c-f4591665e764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:46.590428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cec9b6-8f3c-4202-ab0c-f4591665e764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.591850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cec9b6-8f3c-4202-ab0c-f4591665e764 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.603660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 200/399] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:46.604471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cec9b6-8f3c-4202-ab0c-f4591665e764 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.637696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25df3c3-ef36-4f14-8d42-39e39d88e03c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.670793 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce8820-46f3-43fe-a334-b6c0a258db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.671383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce8820-46f3-43fe-a334-b6c0a258db58 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.671660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce8820-46f3-43fe-a334-b6c0a258db58 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.671929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce8820-46f3-43fe-a334-b6c0a258db58 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.679045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce8820-46f3-43fe-a334-b6c0a258db58 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.680485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce8820-46f3-43fe-a334-b6c0a258db58 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-ffce8820-46f3-43fe-a334-b6c0a258db58 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:46.691938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:46.692817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:46.693759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 200/400] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:46.694315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce8820-46f3-43fe-a334-b6c0a258db58 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.709471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cec9b6-8f3c-4202-ab0c-f4591665e764 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.736511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:46.737681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:46.744299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da3017-f213-45fa-be8d-134145288e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.744910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da3017-f213-45fa-be8d-134145288e16 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.745186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da3017-f213-45fa-be8d-134145288e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.745457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da3017-f213-45fa-be8d-134145288e16 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.746179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da3017-f213-45fa-be8d-134145288e16 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:46.746468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da3017-f213-45fa-be8d-134145288e16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.747968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da3017-f213-45fa-be8d-134145288e16 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.765221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 201/401] 10.222.0.46 () {56 vars in 1139 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:46.766010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da3017-f213-45fa-be8d-134145288e16 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.799225 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce8820-46f3-43fe-a334-b6c0a258db58 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.834311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3090132-f745-4a8c-8e82-6a5798dcbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.834916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090132-f745-4a8c-8e82-6a5798dcbc4d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.835209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090132-f745-4a8c-8e82-6a5798dcbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.835469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090132-f745-4a8c-8e82-6a5798dcbc4d None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.836159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3090132-f745-4a8c-8e82-6a5798dcbc4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:46.836450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3090132-f745-4a8c-8e82-6a5798dcbc4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.837882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3090132-f745-4a8c-8e82-6a5798dcbc4d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.855595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 201/402] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:46.856440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3090132-f745-4a8c-8e82-6a5798dcbc4d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.872404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da3017-f213-45fa-be8d-134145288e16 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.906241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c318835-26c4-40bc-a131-d1b2b6efd3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:46.907170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c318835-26c4-40bc-a131-d1b2b6efd3a1 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:46.907447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c318835-26c4-40bc-a131-d1b2b6efd3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:46.907719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c318835-26c4-40bc-a131-d1b2b6efd3a1 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:46.908358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c318835-26c4-40bc-a131-d1b2b6efd3a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:46.909835 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c318835-26c4-40bc-a131-d1b2b6efd3a1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:46.933864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 202/403] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:46 2022] POST /identity/v3/users => generated 247 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:46.934697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c318835-26c4-40bc-a131-d1b2b6efd3a1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:46.957497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:46.961925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3090132-f745-4a8c-8e82-6a5798dcbc4d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:46.989317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:47.002483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314df21-50bc-40e1-8d0a-13eea87edb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:47.003182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314df21-50bc-40e1-8d0a-13eea87edb31 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:47.003459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314df21-50bc-40e1-8d0a-13eea87edb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:47.003728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314df21-50bc-40e1-8d0a-13eea87edb31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:47.011579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314df21-50bc-40e1-8d0a-13eea87edb31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:47.013086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314df21-50bc-40e1-8d0a-13eea87edb31 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-7314df21-50bc-40e1-8d0a-13eea87edb31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:47.025833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:47.027306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:47.028470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:47.028470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:47.028470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:47.028470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:47.028470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:47.028470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:47.028470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:47.028470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:47.032414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 202/404] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:47.033186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314df21-50bc-40e1-8d0a-13eea87edb31 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:47.063296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c318835-26c4-40bc-a131-d1b2b6efd3a1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:47.102689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafc3dd-21d0-4897-bbad-78781e3391a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:47.103502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafc3dd-21d0-4897-bbad-78781e3391a9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:47.104144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafc3dd-21d0-4897-bbad-78781e3391a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:47.104144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafc3dd-21d0-4897-bbad-78781e3391a9 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:47.104997 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafc3dd-21d0-4897-bbad-78781e3391a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:47.105403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafc3dd-21d0-4897-bbad-78781e3391a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:47.106949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafc3dd-21d0-4897-bbad-78781e3391a9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:47.126682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 203/405] 10.222.0.46 () {56 vars in 1137 bytes} [Mon Oct 24 13:29:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:47.126888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafc3dd-21d0-4897-bbad-78781e3391a9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:47.157184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314df21-50bc-40e1-8d0a-13eea87edb31 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:47.205035 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5cb1-4c5c-43b0-929c-93f1510a6030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:47.205746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5cb1-4c5c-43b0-929c-93f1510a6030 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:47.206077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5cb1-4c5c-43b0-929c-93f1510a6030 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:47.206410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5cb1-4c5c-43b0-929c-93f1510a6030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:47.218852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d5cb1-4c5c-43b0-929c-93f1510a6030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:47.220418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d5cb1-4c5c-43b0-929c-93f1510a6030 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-022d5cb1-4c5c-43b0-929c-93f1510a6030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:47.235144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:47.236297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:47.237330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:47.237330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:47.237330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:47.237536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafc3dd-21d0-4897-bbad-78781e3391a9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:47.242671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 203/406] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:47.242671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5cb1-4c5c-43b0-929c-93f1510a6030 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:47.243342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:47.252088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:47.284261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e989979-d840-4bef-97b3-edbee49182e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:47.284946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e989979-d840-4bef-97b3-edbee49182e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:47.285244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e989979-d840-4bef-97b3-edbee49182e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:47.285487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e989979-d840-4bef-97b3-edbee49182e5 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/3f5b069b5307470e96176481702d6e63/roles/69a1febe83c9483cb6175c815d7e4f8e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:47.302350 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e989979-d840-4bef-97b3-edbee49182e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=3f5b069b5307470e96176481702d6e63, role_id=69a1febe83c9483cb6175c815d7e4f8e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:47.304099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e989979-d840-4bef-97b3-edbee49182e5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:47.318956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 204/407] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:47 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/3f5b069b5307470e96176481702d6e63/roles/69a1febe83c9483cb6175c815d7e4f8e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:47.319809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e989979-d840-4bef-97b3-edbee49182e5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:47.350585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5cb1-4c5c-43b0-929c-93f1510a6030 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:47.397445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac2c40-a863-4554-9f70-d3f4221c6b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:47.398491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac2c40-a863-4554-9f70-d3f4221c6b8b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:47.398874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac2c40-a863-4554-9f70-d3f4221c6b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:47.399283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac2c40-a863-4554-9f70-d3f4221c6b8b None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:47.400095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac2c40-a863-4554-9f70-d3f4221c6b8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:47.400483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac2c40-a863-4554-9f70-d3f4221c6b8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:47.402457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac2c40-a863-4554-9f70-d3f4221c6b8b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:47.422059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 204/408] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:47.423220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac2c40-a863-4554-9f70-d3f4221c6b8b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:47.461726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e989979-d840-4bef-97b3-edbee49182e5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:47.503995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59b39c-c178-48bc-9429-6a575881cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:47.504941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b39c-c178-48bc-9429-6a575881cb46 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:47.505602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b39c-c178-48bc-9429-6a575881cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:47.506093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b39c-c178-48bc-9429-6a575881cb46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:47.507366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:47.520978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59b39c-c178-48bc-9429-6a575881cb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:47.523100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59b39c-c178-48bc-9429-6a575881cb46 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ee59b39c-c178-48bc-9429-6a575881cb46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:47.545446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:47.546571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:47.547642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:47.547642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:47.547642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:47.547642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 205/409] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:47.552006 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59b39c-c178-48bc-9429-6a575881cb46 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:47.554581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:47.556956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac2c40-a863-4554-9f70-d3f4221c6b8b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:47.601799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad8a40-119c-425d-9f25-27fa3bee8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:47.602634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad8a40-119c-425d-9f25-27fa3bee8452 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:47.605022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad8a40-119c-425d-9f25-27fa3bee8452 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:47.605480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad8a40-119c-425d-9f25-27fa3bee8452 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:47.606144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad8a40-119c-425d-9f25-27fa3bee8452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:47.606447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad8a40-119c-425d-9f25-27fa3bee8452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:47.607916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad8a40-119c-425d-9f25-27fa3bee8452 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:47.623059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 205/410] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:47.624328 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad8a40-119c-425d-9f25-27fa3bee8452 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:47.691559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59b39c-c178-48bc-9429-6a575881cb46 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:47.736743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4ff97-40eb-4a8c-8dba-e32572ac42c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:47.737633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4ff97-40eb-4a8c-8dba-e32572ac42c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:47.737917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4ff97-40eb-4a8c-8dba-e32572ac42c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:47.738192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4ff97-40eb-4a8c-8dba-e32572ac42c7 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/68d8ec9210f54c6698477d7dbbe46a2d/roles/69a1febe83c9483cb6175c815d7e4f8e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:47.744735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad8a40-119c-425d-9f25-27fa3bee8452 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:47.762884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4ff97-40eb-4a8c-8dba-e32572ac42c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=68d8ec9210f54c6698477d7dbbe46a2d, role_id=69a1febe83c9483cb6175c815d7e4f8e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:47.764744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4ff97-40eb-4a8c-8dba-e32572ac42c7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:47.779923 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:47.787073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc93c-2f0a-4e00-b497-85a32c82167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:47.788189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc93c-2f0a-4e00-b497-85a32c82167f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:47.788656 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc93c-2f0a-4e00-b497-85a32c82167f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:47.789108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc93c-2f0a-4e00-b497-85a32c82167f None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:47.789998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cc93c-2f0a-4e00-b497-85a32c82167f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:47.790540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cc93c-2f0a-4e00-b497-85a32c82167f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:47.790829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 206/411] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:47 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/68d8ec9210f54c6698477d7dbbe46a2d/roles/69a1febe83c9483cb6175c815d7e4f8e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:47.791834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4ff97-40eb-4a8c-8dba-e32572ac42c7 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:47.792647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cc93c-2f0a-4e00-b497-85a32c82167f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:47.807751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 206/412] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:47.813506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc93c-2f0a-4e00-b497-85a32c82167f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:47.908219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:48.002087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc93c-2f0a-4e00-b497-85a32c82167f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:48.025611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4ff97-40eb-4a8c-8dba-e32572ac42c7 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:48.043289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d5a87-2f1b-4528-980d-54c4eee5a268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:48.043289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d5a87-2f1b-4528-980d-54c4eee5a268 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:48.043289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d5a87-2f1b-4528-980d-54c4eee5a268 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:48.043289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d5a87-2f1b-4528-980d-54c4eee5a268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:48.055937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d5a87-2f1b-4528-980d-54c4eee5a268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:48.057504 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d5a87-2f1b-4528-980d-54c4eee5a268 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-241d5a87-2f1b-4528-980d-54c4eee5a268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:48.071019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:48.071915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:48.075627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:48.075627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:48.075627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:48.075627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:48.075627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:48.075627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:48.075627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:48.075627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:48.075627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 207/413] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:29:48.079122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d5a87-2f1b-4528-980d-54c4eee5a268 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:48.082578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b0a34-ff23-496d-a4be-64fa5422b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:48.084146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b0a34-ff23-496d-a4be-64fa5422b367 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:48.084146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b0a34-ff23-496d-a4be-64fa5422b367 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:48.084146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b0a34-ff23-496d-a4be-64fa5422b367 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:48.092446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b0a34-ff23-496d-a4be-64fa5422b367 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:48.094122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b0a34-ff23-496d-a4be-64fa5422b367 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-7d3b0a34-ff23-496d-a4be-64fa5422b367 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:48.106808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:48.107904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:48.108945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:48.108945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:48.108945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:48.108945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:48.108945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:48.108945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:48.108945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:48.108945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:48.112834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 207/414] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:48.117586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b0a34-ff23-496d-a4be-64fa5422b367 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:48.139780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:48.199332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d5a87-2f1b-4528-980d-54c4eee5a268 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:48.253035 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd2ab8-a689-410a-be3c-3c6fc787c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:48.254693 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd2ab8-a689-410a-be3c-3c6fc787c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:48.255786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd2ab8-a689-410a-be3c-3c6fc787c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:48.256318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd2ab8-a689-410a-be3c-3c6fc787c4a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:48.257385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd2ab8-a689-410a-be3c-3c6fc787c4a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:48.258030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd2ab8-a689-410a-be3c-3c6fc787c4a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:48.260971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd2ab8-a689-410a-be3c-3c6fc787c4a8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:48.266718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b0a34-ff23-496d-a4be-64fa5422b367 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:48.291628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 208/415] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:48.295300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:48.304409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd2ab8-a689-410a-be3c-3c6fc787c4a8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:48.342022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebdd57-a1b6-47d7-afb3-6c583f0ba827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:48.342864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebdd57-a1b6-47d7-afb3-6c583f0ba827 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:48.344249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebdd57-a1b6-47d7-afb3-6c583f0ba827 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:48.345784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebdd57-a1b6-47d7-afb3-6c583f0ba827 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:48.346610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebdd57-a1b6-47d7-afb3-6c583f0ba827 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:48.347221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebdd57-a1b6-47d7-afb3-6c583f0ba827 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:48.350311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebdd57-a1b6-47d7-afb3-6c583f0ba827 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:48.372828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 208/416] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:48.378810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebdd57-a1b6-47d7-afb3-6c583f0ba827 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:48.490629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebdd57-a1b6-47d7-afb3-6c583f0ba827 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:48.528975 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54181-0553-433d-9761-ae3fb5018922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:48.529720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54181-0553-433d-9761-ae3fb5018922 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:48.530087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54181-0553-433d-9761-ae3fb5018922 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:48.530470 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54181-0553-433d-9761-ae3fb5018922 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/fe801da792944be2b6342c483bcb88b6/roles/69a1febe83c9483cb6175c815d7e4f8e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:48.546692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54181-0553-433d-9761-ae3fb5018922 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=fe801da792944be2b6342c483bcb88b6, role_id=69a1febe83c9483cb6175c815d7e4f8e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:48.548386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54181-0553-433d-9761-ae3fb5018922 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:48.550270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd2ab8-a689-410a-be3c-3c6fc787c4a8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:48.567832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 209/417] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:48 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/fe801da792944be2b6342c483bcb88b6/roles/69a1febe83c9483cb6175c815d7e4f8e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:48.575251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:48.629739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc56a2-402c-4a94-aa8e-fe6ee26c9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:48.630435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc56a2-402c-4a94-aa8e-fe6ee26c9030 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:48.630712 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc56a2-402c-4a94-aa8e-fe6ee26c9030 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:48.631389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc56a2-402c-4a94-aa8e-fe6ee26c9030 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/37c812964d514d3f8082f90d0f512246/roles/69a1febe83c9483cb6175c815d7e4f8e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:48.655077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc56a2-402c-4a94-aa8e-fe6ee26c9030 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=37c812964d514d3f8082f90d0f512246, role_id=69a1febe83c9483cb6175c815d7e4f8e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:48.656548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc56a2-402c-4a94-aa8e-fe6ee26c9030 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:48.698856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 209/418] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:48 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/37c812964d514d3f8082f90d0f512246/roles/69a1febe83c9483cb6175c815d7e4f8e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:29:49.327152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e5fbc-2e6e-4ad2-93f1-005b8f68942a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:49.327835 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e5fbc-2e6e-4ad2-93f1-005b8f68942a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:49.328308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e5fbc-2e6e-4ad2-93f1-005b8f68942a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:49.330129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 210/419] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:49.335568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e307-faf6-46ed-8fe7-05554f2cf391 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:49.336144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e307-faf6-46ed-8fe7-05554f2cf391 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:49.336623 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e307-faf6-46ed-8fe7-05554f2cf391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:49.359440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3725e307-faf6-46ed-8fe7-05554f2cf391 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:49.360953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3725e307-faf6-46ed-8fe7-05554f2cf391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:49.457803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 210/420] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:49.758535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e5fbc-2e6e-4ad2-93f1-005b8f68942a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:49.794466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:49.838171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86157ae4-7b1b-4803-9ec2-578fd21a0bbd None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:49.839132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86157ae4-7b1b-4803-9ec2-578fd21a0bbd None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:49.839586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86157ae4-7b1b-4803-9ec2-578fd21a0bbd None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:49.841118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 211/421] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:49.846966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2ebbf-5b12-4f3c-9313-244013dc6414 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:49.847719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2ebbf-5b12-4f3c-9313-244013dc6414 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:49.848180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2ebbf-5b12-4f3c-9313-244013dc6414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:49.875160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-22d2ebbf-5b12-4f3c-9313-244013dc6414 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:49.876874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-22d2ebbf-5b12-4f3c-9313-244013dc6414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:49.926001 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e5fbc-2e6e-4ad2-93f1-005b8f68942a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:49.994789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586678d-d6ce-4afc-bd5a-54160f76c35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:49.996080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586678d-d6ce-4afc-bd5a-54160f76c35d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:49.997824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586678d-d6ce-4afc-bd5a-54160f76c35d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:49.998653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586678d-d6ce-4afc-bd5a-54160f76c35d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:50.001228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 212/422] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:50.014095 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586678d-d6ce-4afc-bd5a-54160f76c35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0586678d-d6ce-4afc-bd5a-54160f76c35d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:50.023816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:50.024766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:50.025559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 211/423] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:50.031490 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2ebbf-5b12-4f3c-9313-244013dc6414 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:50.070538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:50.180854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2ebbf-5b12-4f3c-9313-244013dc6414 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:50.226641 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfdf19-df51-42c0-b6d7-bd91f0e04347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:50.227653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfdf19-df51-42c0-b6d7-bd91f0e04347 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:50.228141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfdf19-df51-42c0-b6d7-bd91f0e04347 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:50.228592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfdf19-df51-42c0-b6d7-bd91f0e04347 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:50.229444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfdf19-df51-42c0-b6d7-bd91f0e04347 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:50.229929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfdf19-df51-42c0-b6d7-bd91f0e04347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:50.231502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfdf19-df51-42c0-b6d7-bd91f0e04347 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:50.247063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 213/424] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:50.252341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586678d-d6ce-4afc-bd5a-54160f76c35d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:50.364594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfdf19-df51-42c0-b6d7-bd91f0e04347 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:50.372261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:50.406538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586678d-d6ce-4afc-bd5a-54160f76c35d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:50.471548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606718b-8261-490a-ae84-f1b9c9c668c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:50.472186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606718b-8261-490a-ae84-f1b9c9c668c7 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:50.472460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606718b-8261-490a-ae84-f1b9c9c668c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:50.472729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606718b-8261-490a-ae84-f1b9c9c668c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:50.492651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606718b-8261-490a-ae84-f1b9c9c668c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:50.494150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606718b-8261-490a-ae84-f1b9c9c668c7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f606718b-8261-490a-ae84-f1b9c9c668c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:50.520503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:50.521512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:50.522472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:50.522472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:50.522472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:50.522472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 212/425] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:50.529959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:50.530479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0fb83-a3d7-4ee2-8c52-859c8389ec8e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:50.530762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0fb83-a3d7-4ee2-8c52-859c8389ec8e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:50.531093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0fb83-a3d7-4ee2-8c52-859c8389ec8e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:50.533031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 213/426] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:29:50.534629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0fb83-a3d7-4ee2-8c52-859c8389ec8e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:50.552906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfdf19-df51-42c0-b6d7-bd91f0e04347 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:50.587351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db87a8-e2ac-4c05-8ecd-8b49c89ca4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:50.588095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db87a8-e2ac-4c05-8ecd-8b49c89ca4cd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:50.588371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db87a8-e2ac-4c05-8ecd-8b49c89ca4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:50.588636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db87a8-e2ac-4c05-8ecd-8b49c89ca4cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:50.599305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db87a8-e2ac-4c05-8ecd-8b49c89ca4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-35db87a8-e2ac-4c05-8ecd-8b49c89ca4cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:50.604763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:50.605648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:50.606422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 214/427] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:29:50.611457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e9bf1-8fe6-495d-a304-286471ad5982 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:50.611457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e9bf1-8fe6-495d-a304-286471ad5982 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:50.611457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e9bf1-8fe6-495d-a304-286471ad5982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:50.629940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b43e9bf1-8fe6-495d-a304-286471ad5982 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:50.632169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b43e9bf1-8fe6-495d-a304-286471ad5982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:50.663437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0fb83-a3d7-4ee2-8c52-859c8389ec8e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:50.706115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb981889-6a7b-44c7-9ba9-f31449f776fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:50.706979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb981889-6a7b-44c7-9ba9-f31449f776fb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:50.707263 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb981889-6a7b-44c7-9ba9-f31449f776fb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:50.707535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb981889-6a7b-44c7-9ba9-f31449f776fb None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:50.708173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb981889-6a7b-44c7-9ba9-f31449f776fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:50.708471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb981889-6a7b-44c7-9ba9-f31449f776fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:50.710641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb981889-6a7b-44c7-9ba9-f31449f776fb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:50.714555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:50.733011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 214/428] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:50.733539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 215/429] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:50.733901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb981889-6a7b-44c7-9ba9-f31449f776fb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:50.734960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e9bf1-8fe6-495d-a304-286471ad5982 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:50.821432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:50.852736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e9bf1-8fe6-495d-a304-286471ad5982 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:50.914762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854b0fb-6130-4d81-ac32-2d2703c0a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:50.915916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854b0fb-6130-4d81-ac32-2d2703c0a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:50.916494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854b0fb-6130-4d81-ac32-2d2703c0a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:50.916821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854b0fb-6130-4d81-ac32-2d2703c0a5f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:50.925376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854b0fb-6130-4d81-ac32-2d2703c0a5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:50.934432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854b0fb-6130-4d81-ac32-2d2703c0a5f0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:50.937673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb981889-6a7b-44c7-9ba9-f31449f776fb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-8854b0fb-6130-4d81-ac32-2d2703c0a5f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:50.950003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:50.951006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:50.952515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 216/430] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:29:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:50.959538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854b0fb-6130-4d81-ac32-2d2703c0a5f0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.005258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f466173-b798-45bf-b67c-bcd3631bcdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.005978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f466173-b798-45bf-b67c-bcd3631bcdca None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.006252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f466173-b798-45bf-b67c-bcd3631bcdca None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.006514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f466173-b798-45bf-b67c-bcd3631bcdca None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.007318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f466173-b798-45bf-b67c-bcd3631bcdca None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:51.007635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f466173-b798-45bf-b67c-bcd3631bcdca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:51.009109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f466173-b798-45bf-b67c-bcd3631bcdca None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:51.018034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 215/431] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:51.023935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f466173-b798-45bf-b67c-bcd3631bcdca None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.091577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:51.146873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854b0fb-6130-4d81-ac32-2d2703c0a5f0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:51.153414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f466173-b798-45bf-b67c-bcd3631bcdca None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:51.180044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:51.186479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3de43-cdc1-41ee-befd-a8faccd8ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.187120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3de43-cdc1-41ee-befd-a8faccd8ef81 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.187386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3de43-cdc1-41ee-befd-a8faccd8ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.187649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3de43-cdc1-41ee-befd-a8faccd8ef81 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.188380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3de43-cdc1-41ee-befd-a8faccd8ef81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:51.188678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3de43-cdc1-41ee-befd-a8faccd8ef81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:51.189749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef017b4a-98fb-4c1d-b783-004a0c20291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.190136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3de43-cdc1-41ee-befd-a8faccd8ef81 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:51.190387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017b4a-98fb-4c1d-b783-004a0c20291e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.190661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017b4a-98fb-4c1d-b783-004a0c20291e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.190944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017b4a-98fb-4c1d-b783-004a0c20291e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.202861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef017b4a-98fb-4c1d-b783-004a0c20291e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:51.204368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef017b4a-98fb-4c1d-b783-004a0c20291e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:51.210354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 217/432] 10.222.0.46 () {56 vars in 1135 bytes} [Mon Oct 24 13:29:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:51.211243 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3de43-cdc1-41ee-befd-a8faccd8ef81 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ef017b4a-98fb-4c1d-b783-004a0c20291e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:51.224138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:51.226679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:51.228829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:51.228829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:51.228829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:51.228829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 216/433] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:29:51.228829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef017b4a-98fb-4c1d-b783-004a0c20291e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.319421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3de43-cdc1-41ee-befd-a8faccd8ef81 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:51.340725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef017b4a-98fb-4c1d-b783-004a0c20291e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:51.355158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:51.358970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b4316-27ba-491d-9934-c88c585a7a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.359622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b4316-27ba-491d-9934-c88c585a7a7f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.359891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b4316-27ba-491d-9934-c88c585a7a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.360154 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b4316-27ba-491d-9934-c88c585a7a7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.381410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b4316-27ba-491d-9934-c88c585a7a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:51.385115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4354e3-02b8-42be-b372-7575a0042940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.385831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4354e3-02b8-42be-b372-7575a0042940 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.386115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4354e3-02b8-42be-b372-7575a0042940 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.386388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4354e3-02b8-42be-b372-7575a0042940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-754b4316-27ba-491d-9934-c88c585a7a7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:51.386673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:51.387529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:51.388305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:51.392929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 218/434] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:51.393582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b4316-27ba-491d-9934-c88c585a7a7f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.399683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4354e3-02b8-42be-b372-7575a0042940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:51.401172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4354e3-02b8-42be-b372-7575a0042940 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0d4354e3-02b8-42be-b372-7575a0042940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:51.417428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:51.418518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:51.419406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:51.419406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:51.419406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:51.419406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 217/435] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:51.419743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefdc8-bb4a-4e06-959c-01cb8b0f58b6 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.420023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefdc8-bb4a-4e06-959c-01cb8b0f58b6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.420286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefdc8-bb4a-4e06-959c-01cb8b0f58b6 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.422963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 218/436] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:51.422963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeefdc8-bb4a-4e06-959c-01cb8b0f58b6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.456699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:51.507464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b4316-27ba-491d-9934-c88c585a7a7f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:51.535235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeefdc8-bb4a-4e06-959c-01cb8b0f58b6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:51.541259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e92a1-84b6-4727-b2b1-0e9022ff7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.541869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e92a1-84b6-4727-b2b1-0e9022ff7bff None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.542170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e92a1-84b6-4727-b2b1-0e9022ff7bff None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.542432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e92a1-84b6-4727-b2b1-0e9022ff7bff None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.543104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e92a1-84b6-4727-b2b1-0e9022ff7bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:51.543401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e92a1-84b6-4727-b2b1-0e9022ff7bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:51.544776 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e92a1-84b6-4727-b2b1-0e9022ff7bff None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:51.556177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 219/437] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:51.557010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e92a1-84b6-4727-b2b1-0e9022ff7bff None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.571467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8975c38-358c-46c6-befa-47a5187b164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.572055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8975c38-358c-46c6-befa-47a5187b164b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.572325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8975c38-358c-46c6-befa-47a5187b164b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.572588 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8975c38-358c-46c6-befa-47a5187b164b None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.573236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8975c38-358c-46c6-befa-47a5187b164b None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:51.573527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8975c38-358c-46c6-befa-47a5187b164b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:51.574913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8975c38-358c-46c6-befa-47a5187b164b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:51.583311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 219/438] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:51.584541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045197d6-6b42-4fa5-9e32-fd678eca9485 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.584810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045197d6-6b42-4fa5-9e32-fd678eca9485 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.585075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045197d6-6b42-4fa5-9e32-fd678eca9485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.603307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-045197d6-6b42-4fa5-9e32-fd678eca9485 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:51.604505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-045197d6-6b42-4fa5-9e32-fd678eca9485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:51.623137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:51.658198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e92a1-84b6-4727-b2b1-0e9022ff7bff None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:51.668629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:51.677390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 220/439] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:51.679062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5387e00-6ccd-4015-9ce7-6115a9eca3f2 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.679327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5387e00-6ccd-4015-9ce7-6115a9eca3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.679599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5387e00-6ccd-4015-9ce7-6115a9eca3f2 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.680870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 221/440] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:51.683126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5387e00-6ccd-4015-9ce7-6115a9eca3f2 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.698908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32e882-2c43-4b49-a5f8-d03e634eb3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.699547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32e882-2c43-4b49-a5f8-d03e634eb3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.699842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32e882-2c43-4b49-a5f8-d03e634eb3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.700153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32e882-2c43-4b49-a5f8-d03e634eb3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.700812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32e882-2c43-4b49-a5f8-d03e634eb3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:51.701097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32e882-2c43-4b49-a5f8-d03e634eb3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:51.702464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32e882-2c43-4b49-a5f8-d03e634eb3e4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:51.716201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 220/441] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:51.716872 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32e882-2c43-4b49-a5f8-d03e634eb3e4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.801814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5387e00-6ccd-4015-9ce7-6115a9eca3f2 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:51.822969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32e882-2c43-4b49-a5f8-d03e634eb3e4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:51.840601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43412402-8182-422e-ab38-612ee4ed4046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.841237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412402-8182-422e-ab38-612ee4ed4046 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.841513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412402-8182-422e-ab38-612ee4ed4046 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.841780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412402-8182-422e-ab38-612ee4ed4046 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.849571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43412402-8182-422e-ab38-612ee4ed4046 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:51.851543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43412402-8182-422e-ab38-612ee4ed4046 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:51.856749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60026c48-ab3f-42b1-8d76-99a3fb65342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:51.857380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60026c48-ab3f-42b1-8d76-99a3fb65342a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.857650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60026c48-ab3f-42b1-8d76-99a3fb65342a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.857914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60026c48-ab3f-42b1-8d76-99a3fb65342a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-43412402-8182-422e-ab38-612ee4ed4046 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:51.863614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:51.864521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:51.865510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 222/442] 10.222.0.46 () {56 vars in 1093 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:51.866624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e73e-1ba9-4db8-9f46-3d474acbb4d0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:51.866624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e73e-1ba9-4db8-9f46-3d474acbb4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:51.866624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e73e-1ba9-4db8-9f46-3d474acbb4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:51.873512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60026c48-ab3f-42b1-8d76-99a3fb65342a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:51.875022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60026c48-ab3f-42b1-8d76-99a3fb65342a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:51.884501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5fc5e73e-1ba9-4db8-9f46-3d474acbb4d0 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:51.885681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5fc5e73e-1ba9-4db8-9f46-3d474acbb4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-60026c48-ab3f-42b1-8d76-99a3fb65342a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:51.890308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:51.891431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:51.892315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:51.892315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:51.892315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:51.895556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:51.896127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 221/443] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:51.897027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60026c48-ab3f-42b1-8d76-99a3fb65342a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:51.922847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:51.956385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 223/444] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:51.957231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e73e-1ba9-4db8-9f46-3d474acbb4d0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.020738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60026c48-ab3f-42b1-8d76-99a3fb65342a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.057383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9894de-0619-4563-9275-e0d1b6c09cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.058113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9894de-0619-4563-9275-e0d1b6c09cec None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.058452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9894de-0619-4563-9275-e0d1b6c09cec None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.058675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e73e-1ba9-4db8-9f46-3d474acbb4d0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.058812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9894de-0619-4563-9275-e0d1b6c09cec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.066028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9894de-0619-4563-9275-e0d1b6c09cec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:52.067503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9894de-0619-4563-9275-e0d1b6c09cec None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-5c9894de-0619-4563-9275-e0d1b6c09cec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:52.081945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:52.082863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:52.083840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:52.083840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:52.083840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:52.083840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:52.083840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:52.083840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:52.083840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:52.083840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:52.085340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 222/445] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:52.091087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9894de-0619-4563-9275-e0d1b6c09cec None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.095300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f91946-5da4-4c82-b063-73171077657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.095916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f91946-5da4-4c82-b063-73171077657c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.096238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f91946-5da4-4c82-b063-73171077657c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.096506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f91946-5da4-4c82-b063-73171077657c None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.097246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f91946-5da4-4c82-b063-73171077657c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:52.097543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f91946-5da4-4c82-b063-73171077657c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:52.099002 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f91946-5da4-4c82-b063-73171077657c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:52.117011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 224/446] 10.222.0.46 () {56 vars in 1133 bytes} [Mon Oct 24 13:29:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:52.117834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f91946-5da4-4c82-b063-73171077657c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.120549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:52.186007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:52.207448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9894de-0619-4563-9275-e0d1b6c09cec None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.220217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f91946-5da4-4c82-b063-73171077657c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.243433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec21e4-a1fd-4eef-832f-ce79c2510ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.244042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec21e4-a1fd-4eef-832f-ce79c2510ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.244313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec21e4-a1fd-4eef-832f-ce79c2510ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.244587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec21e4-a1fd-4eef-832f-ce79c2510ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.245221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec21e4-a1fd-4eef-832f-ce79c2510ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:52.245520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec21e4-a1fd-4eef-832f-ce79c2510ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:52.246890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec21e4-a1fd-4eef-832f-ce79c2510ec3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:52.253685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1899-2bda-4470-a44e-94818535acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.254309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1899-2bda-4470-a44e-94818535acb4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.254578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1899-2bda-4470-a44e-94818535acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.254841 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1899-2bda-4470-a44e-94818535acb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.258956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 223/447] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:52.259744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec21e4-a1fd-4eef-832f-ce79c2510ec3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.265882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d1899-2bda-4470-a44e-94818535acb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-7b4d1899-2bda-4470-a44e-94818535acb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:52.270826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:52.271807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:52.272589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 225/448] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:52.273238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1899-2bda-4470-a44e-94818535acb4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.335349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:52.364843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec21e4-a1fd-4eef-832f-ce79c2510ec3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.375121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1899-2bda-4470-a44e-94818535acb4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.402026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a8f2c-8b63-42ba-9a5f-d668e46fd919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.402631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a8f2c-8b63-42ba-9a5f-d668e46fd919 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.402905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a8f2c-8b63-42ba-9a5f-d668e46fd919 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.403221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a8f2c-8b63-42ba-9a5f-d668e46fd919 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.403905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a8f2c-8b63-42ba-9a5f-d668e46fd919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:52.404200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a8f2c-8b63-42ba-9a5f-d668e46fd919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:52.405751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a8f2c-8b63-42ba-9a5f-d668e46fd919 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:52.411209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb765e28-e811-431d-a410-b85c5359a846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.411818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765e28-e811-431d-a410-b85c5359a846 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.412183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765e28-e811-431d-a410-b85c5359a846 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.412451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765e28-e811-431d-a410-b85c5359a846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.417438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 224/449] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:52.418408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a8f2c-8b63-42ba-9a5f-d668e46fd919 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.420962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:52.484111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb765e28-e811-431d-a410-b85c5359a846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:52.485599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb765e28-e811-431d-a410-b85c5359a846 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:52.520237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a8f2c-8b63-42ba-9a5f-d668e46fd919 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.546884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:52.554527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd30fb-1ed8-4799-ba54-00eb984bd856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.555202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd30fb-1ed8-4799-ba54-00eb984bd856 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.555469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd30fb-1ed8-4799-ba54-00eb984bd856 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.555738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd30fb-1ed8-4799-ba54-00eb984bd856 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.565792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd30fb-1ed8-4799-ba54-00eb984bd856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-10bd30fb-1ed8-4799-ba54-00eb984bd856 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:52.571132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:52.572027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:52.572831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:52.575066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 225/450] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:52.576087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd30fb-1ed8-4799-ba54-00eb984bd856 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.587435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 226/451] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:52.588277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb765e28-e811-431d-a410-b85c5359a846 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.640062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:52.678479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd30fb-1ed8-4799-ba54-00eb984bd856 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.685294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb765e28-e811-431d-a410-b85c5359a846 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.715647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120fc08-880a-4ef1-9f6b-306ea6fecd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.716274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120fc08-880a-4ef1-9f6b-306ea6fecd46 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.716546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120fc08-880a-4ef1-9f6b-306ea6fecd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.716807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120fc08-880a-4ef1-9f6b-306ea6fecd46 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.720244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95d2b1-00aa-4087-a94d-ab293a127699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.720851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d2b1-00aa-4087-a94d-ab293a127699 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.721134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d2b1-00aa-4087-a94d-ab293a127699 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.721404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d2b1-00aa-4087-a94d-ab293a127699 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.722061 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95d2b1-00aa-4087-a94d-ab293a127699 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:52.722358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95d2b1-00aa-4087-a94d-ab293a127699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:52.723770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95d2b1-00aa-4087-a94d-ab293a127699 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:52.724370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120fc08-880a-4ef1-9f6b-306ea6fecd46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:52.726168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120fc08-880a-4ef1-9f6b-306ea6fecd46 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:52.732371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 227/452] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:52.733067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95d2b1-00aa-4087-a94d-ab293a127699 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-5120fc08-880a-4ef1-9f6b-306ea6fecd46 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:52.738042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:52.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 226/453] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:52.739968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120fc08-880a-4ef1-9f6b-306ea6fecd46 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.761254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:52.838128 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95d2b1-00aa-4087-a94d-ab293a127699 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.848347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120fc08-880a-4ef1-9f6b-306ea6fecd46 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:52.871876 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:52.872541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e1168-2ee1-45a2-834f-c189f872ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.872809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e1168-2ee1-45a2-834f-c189f872ef0c None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.873178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e1168-2ee1-45a2-834f-c189f872ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.873345 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e1168-2ee1-45a2-834f-c189f872ef0c None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/28110c7825734d229ac61878eacbe49e/roles/69a1febe83c9483cb6175c815d7e4f8e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.884609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04692c51-6052-44fb-a4d8-cbcb435210a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:52.885224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04692c51-6052-44fb-a4d8-cbcb435210a7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:52.885475 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04692c51-6052-44fb-a4d8-cbcb435210a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:52.885807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04692c51-6052-44fb-a4d8-cbcb435210a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:52.886471 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04692c51-6052-44fb-a4d8-cbcb435210a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:52.886762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04692c51-6052-44fb-a4d8-cbcb435210a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:52.888174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04692c51-6052-44fb-a4d8-cbcb435210a7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:52.888522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e1168-2ee1-45a2-834f-c189f872ef0c None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=28110c7825734d229ac61878eacbe49e, role_id=69a1febe83c9483cb6175c815d7e4f8e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:52.889979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e1168-2ee1-45a2-834f-c189f872ef0c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:52.896940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 227/454] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:52.897868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04692c51-6052-44fb-a4d8-cbcb435210a7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.907315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 228/455] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:29:52 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/28110c7825734d229ac61878eacbe49e/roles/69a1febe83c9483cb6175c815d7e4f8e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:29:52.908207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e1168-2ee1-45a2-834f-c189f872ef0c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:52.998445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.022594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04692c51-6052-44fb-a4d8-cbcb435210a7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.028766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e1168-2ee1-45a2-834f-c189f872ef0c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.061024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a7fe0-bdb1-4d21-924d-2e92727344eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.061680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a7fe0-bdb1-4d21-924d-2e92727344eb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.061955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a7fe0-bdb1-4d21-924d-2e92727344eb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.062223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a7fe0-bdb1-4d21-924d-2e92727344eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.068477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8182-5086-49bb-8aad-f393970d2691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.069445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8182-5086-49bb-8aad-f393970d2691 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.069795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8182-5086-49bb-8aad-f393970d2691 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.070004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8182-5086-49bb-8aad-f393970d2691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.074342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a7fe0-bdb1-4d21-924d-2e92727344eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.075877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a7fe0-bdb1-4d21-924d-2e92727344eb None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.082213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d8182-5086-49bb-8aad-f393970d2691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.083754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d8182-5086-49bb-8aad-f393970d2691 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-946a7fe0-bdb1-4d21-924d-2e92727344eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:53.092167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:53.093275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:53.094134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:53.094134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:53.094134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:53.094134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 228/456] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:53.094134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a7fe0-bdb1-4d21-924d-2e92727344eb None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b84d8182-5086-49bb-8aad-f393970d2691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:53.104855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:53.105970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:53.107026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:53.107026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:53.107026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:53.107026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 229/457] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:53.107026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8182-5086-49bb-8aad-f393970d2691 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.136350 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.207061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a7fe0-bdb1-4d21-924d-2e92727344eb None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.212795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8182-5086-49bb-8aad-f393970d2691 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.238580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.244992 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb9bfd-a435-404c-8517-de54c81cf289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.245593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb9bfd-a435-404c-8517-de54c81cf289 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.245873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb9bfd-a435-404c-8517-de54c81cf289 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.246211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb9bfd-a435-404c-8517-de54c81cf289 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.246885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb9bfd-a435-404c-8517-de54c81cf289 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:53.247211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb9bfd-a435-404c-8517-de54c81cf289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.248663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb9bfd-a435-404c-8517-de54c81cf289 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.249089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a06ba-8838-48cd-ab49-d99cd3e9b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.249724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a06ba-8838-48cd-ab49-d99cd3e9b8ae None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.250001 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a06ba-8838-48cd-ab49-d99cd3e9b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.250280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a06ba-8838-48cd-ab49-d99cd3e9b8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.262744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a06ba-8838-48cd-ab49-d99cd3e9b8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.264236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a06ba-8838-48cd-ab49-d99cd3e9b8ae None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.272794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 229/458] 10.222.0.46 () {56 vars in 1137 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:53.272794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb9bfd-a435-404c-8517-de54c81cf289 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-658a06ba-8838-48cd-ab49-d99cd3e9b8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:53.282442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:53.283806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:53.284633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:53.284633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:53.284633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:53.284633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 230/459] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:53.284633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a06ba-8838-48cd-ab49-d99cd3e9b8ae None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.383314 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.391862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb9bfd-a435-404c-8517-de54c81cf289 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.395972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a06ba-8838-48cd-ab49-d99cd3e9b8ae None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.429277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac199e9-b4c8-4f82-af57-5ef143d79f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.429993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac199e9-b4c8-4f82-af57-5ef143d79f04 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.430268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac199e9-b4c8-4f82-af57-5ef143d79f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.430533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac199e9-b4c8-4f82-af57-5ef143d79f04 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.431206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac199e9-b4c8-4f82-af57-5ef143d79f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:53.431501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac199e9-b4c8-4f82-af57-5ef143d79f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.432884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac199e9-b4c8-4f82-af57-5ef143d79f04 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.435798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda7f7-0c05-4b94-a0fb-c89648853ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.436353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda7f7-0c05-4b94-a0fb-c89648853ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.436632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda7f7-0c05-4b94-a0fb-c89648853ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.436902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda7f7-0c05-4b94-a0fb-c89648853ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.437614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fda7f7-0c05-4b94-a0fb-c89648853ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:53.437912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fda7f7-0c05-4b94-a0fb-c89648853ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.439312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fda7f7-0c05-4b94-a0fb-c89648853ad3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.445557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 230/460] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:53.448400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac199e9-b4c8-4f82-af57-5ef143d79f04 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.452586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 231/461] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:53.453946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda7f7-0c05-4b94-a0fb-c89648853ad3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.493573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.559825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda7f7-0c05-4b94-a0fb-c89648853ad3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.567958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac199e9-b4c8-4f82-af57-5ef143d79f04 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.594092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ebd58-5e90-4378-ab29-fece7091aad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.594713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ebd58-5e90-4378-ab29-fece7091aad0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.595015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ebd58-5e90-4378-ab29-fece7091aad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.595287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ebd58-5e90-4378-ab29-fece7091aad0 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.595925 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ebd58-5e90-4378-ab29-fece7091aad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:53.596219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ebd58-5e90-4378-ab29-fece7091aad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.597613 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ebd58-5e90-4378-ab29-fece7091aad0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.607342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6502151-d2c2-4be8-a100-8acd7d6ee42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.608213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6502151-d2c2-4be8-a100-8acd7d6ee42f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.608628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6502151-d2c2-4be8-a100-8acd7d6ee42f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.609071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6502151-d2c2-4be8-a100-8acd7d6ee42f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.609213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 232/462] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:53.610115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ebd58-5e90-4378-ab29-fece7091aad0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.641272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.686443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6502151-d2c2-4be8-a100-8acd7d6ee42f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.687961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6502151-d2c2-4be8-a100-8acd7d6ee42f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.716775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.721370 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ebd58-5e90-4378-ab29-fece7091aad0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.756547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bda0c5-15b8-4519-ac67-4bb5d5efb267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.757195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bda0c5-15b8-4519-ac67-4bb5d5efb267 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.757474 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bda0c5-15b8-4519-ac67-4bb5d5efb267 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.757752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bda0c5-15b8-4519-ac67-4bb5d5efb267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.764632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bda0c5-15b8-4519-ac67-4bb5d5efb267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.766102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bda0c5-15b8-4519-ac67-4bb5d5efb267 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b5bda0c5-15b8-4519-ac67-4bb5d5efb267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:53.778114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:53.779063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:53.779922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:53.779922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:53.779922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:53.779922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:53.779922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:53.779922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:53.779922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:53.779922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:53.779922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 233/463] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:53.781390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bda0c5-15b8-4519-ac67-4bb5d5efb267 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.803981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 231/464] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:53.808686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6502151-d2c2-4be8-a100-8acd7d6ee42f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.869389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.889160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bda0c5-15b8-4519-ac67-4bb5d5efb267 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.918501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6502151-d2c2-4be8-a100-8acd7d6ee42f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:53.924991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413ad57-6284-46f5-9b03-2a311fdfa4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.925628 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413ad57-6284-46f5-9b03-2a311fdfa4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.926346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413ad57-6284-46f5-9b03-2a311fdfa4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.926608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413ad57-6284-46f5-9b03-2a311fdfa4e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.935348 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413ad57-6284-46f5-9b03-2a311fdfa4e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.936822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413ad57-6284-46f5-9b03-2a311fdfa4e9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f413ad57-6284-46f5-9b03-2a311fdfa4e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:53.948678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:53.949600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 234/465] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:53.950503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413ad57-6284-46f5-9b03-2a311fdfa4e9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:53.959323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aaf08-7183-46c0-afb8-abe5b671f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:53.959941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aaf08-7183-46c0-afb8-abe5b671f584 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:53.960211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aaf08-7183-46c0-afb8-abe5b671f584 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:53.960462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aaf08-7183-46c0-afb8-abe5b671f584 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:53.968584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68aaf08-7183-46c0-afb8-abe5b671f584 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:53.970043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68aaf08-7183-46c0-afb8-abe5b671f584 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:53.974773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e68aaf08-7183-46c0-afb8-abe5b671f584 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:53.982240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:53.983166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:53.984060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 232/466] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:53.984613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aaf08-7183-46c0-afb8-abe5b671f584 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:54.061462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413ad57-6284-46f5-9b03-2a311fdfa4e9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:54.093780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aaf08-7183-46c0-afb8-abe5b671f584 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:54.097697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac417082-c5da-40af-a7c0-f151502ff460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:54.098594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac417082-c5da-40af-a7c0-f151502ff460 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:54.099081 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac417082-c5da-40af-a7c0-f151502ff460 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:54.099574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac417082-c5da-40af-a7c0-f151502ff460 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:54.100435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac417082-c5da-40af-a7c0-f151502ff460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:54.101305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac417082-c5da-40af-a7c0-f151502ff460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:54.103325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac417082-c5da-40af-a7c0-f151502ff460 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:54.107754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:54.118082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 235/467] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:54.118940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac417082-c5da-40af-a7c0-f151502ff460 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:54.135019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f040a3-1154-4b1c-85cc-2cd503a0205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:54.135658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f040a3-1154-4b1c-85cc-2cd503a0205f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:54.135932 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f040a3-1154-4b1c-85cc-2cd503a0205f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:54.136199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f040a3-1154-4b1c-85cc-2cd503a0205f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:54.147441 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f040a3-1154-4b1c-85cc-2cd503a0205f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:54.148908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f040a3-1154-4b1c-85cc-2cd503a0205f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e0f040a3-1154-4b1c-85cc-2cd503a0205f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:54.164506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:54.165454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:54.170824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:54.170824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:54.170824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:54.170824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 233/468] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:54.170824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f040a3-1154-4b1c-85cc-2cd503a0205f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:54.204863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:54.227430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac417082-c5da-40af-a7c0-f151502ff460 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:54.264956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d0b6-e17d-4e89-815e-d68e41b9c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:54.265553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d0b6-e17d-4e89-815e-d68e41b9c98b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:54.265826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d0b6-e17d-4e89-815e-d68e41b9c98b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:54.266096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d0b6-e17d-4e89-815e-d68e41b9c98b None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:54.266818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50d0b6-e17d-4e89-815e-d68e41b9c98b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:54.267152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50d0b6-e17d-4e89-815e-d68e41b9c98b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:54.268603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50d0b6-e17d-4e89-815e-d68e41b9c98b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:54.281861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f040a3-1154-4b1c-85cc-2cd503a0205f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:54.292912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 236/469] 10.222.0.46 () {56 vars in 1139 bytes} [Mon Oct 24 13:29:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:54.292912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d0b6-e17d-4e89-815e-d68e41b9c98b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:54.321430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3c585-68d6-4ef7-88be-7759c826ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:54.322161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3c585-68d6-4ef7-88be-7759c826ff28 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:54.322350 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3c585-68d6-4ef7-88be-7759c826ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:54.322612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3c585-68d6-4ef7-88be-7759c826ff28 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:54.323531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3c585-68d6-4ef7-88be-7759c826ff28 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:54.323651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3c585-68d6-4ef7-88be-7759c826ff28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:54.325087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3c585-68d6-4ef7-88be-7759c826ff28 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:54.347676 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 234/470] 10.222.0.46 () {56 vars in 1137 bytes} [Mon Oct 24 13:29:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:54.347676 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3c585-68d6-4ef7-88be-7759c826ff28 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:54.371839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:54.410637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d0b6-e17d-4e89-815e-d68e41b9c98b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:54.446002 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af83d-d83d-4216-8636-45acb85eb948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:54.446856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af83d-d83d-4216-8636-45acb85eb948 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:54.447181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af83d-d83d-4216-8636-45acb85eb948 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:54.447457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af83d-d83d-4216-8636-45acb85eb948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:54.448173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809af83d-d83d-4216-8636-45acb85eb948 None admin] RBAC: Adding query filter params (role.id=69a1febe83c9483cb6175c815d7e4f8e, scope.project.id=11342796e85b428195cf5155b512162c, user.id=3f5b069b5307470e96176481702d6e63) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:54.448478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809af83d-d83d-4216-8636-45acb85eb948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:54.449911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809af83d-d83d-4216-8636-45acb85eb948 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:54.453220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:54.459997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3c585-68d6-4ef7-88be-7759c826ff28 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:54.463405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 237/471] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:54 2022] GET /identity/v3/role_assignments?user.id=3f5b069b5307470e96176481702d6e63&scope.project.id=11342796e85b428195cf5155b512162c&role.id=69a1febe83c9483cb6175c815d7e4f8e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:54.464074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af83d-d83d-4216-8636-45acb85eb948 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:54.513804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269c6b3-624f-4d32-9d82-0b0420c01ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:54.514879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269c6b3-624f-4d32-9d82-0b0420c01ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:54.516146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269c6b3-624f-4d32-9d82-0b0420c01ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:54.516643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269c6b3-624f-4d32-9d82-0b0420c01ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:54.517516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269c6b3-624f-4d32-9d82-0b0420c01ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:54.518803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269c6b3-624f-4d32-9d82-0b0420c01ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:54.521301 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269c6b3-624f-4d32-9d82-0b0420c01ec3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:54.539709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 235/472] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:54.540917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269c6b3-624f-4d32-9d82-0b0420c01ec3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:54.591627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af83d-d83d-4216-8636-45acb85eb948 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:54.629690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcfe79-7376-4e3b-a5b0-79d69af24836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:54.630420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcfe79-7376-4e3b-a5b0-79d69af24836 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:54.631407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcfe79-7376-4e3b-a5b0-79d69af24836 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:54.631910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcfe79-7376-4e3b-a5b0-79d69af24836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:54.664246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:54.684062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269c6b3-624f-4d32-9d82-0b0420c01ec3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:54.708779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:54.711712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcfe79-7376-4e3b-a5b0-79d69af24836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:54.713507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcfe79-7376-4e3b-a5b0-79d69af24836 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:54.737007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56350d5c-0af4-46b2-be84-f419abf210e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:54.738184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350d5c-0af4-46b2-be84-f419abf210e9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:54.738462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350d5c-0af4-46b2-be84-f419abf210e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:54.738728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350d5c-0af4-46b2-be84-f419abf210e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:54.827105 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 238/473] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:54.828078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcfe79-7376-4e3b-a5b0-79d69af24836 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:54.840438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56350d5c-0af4-46b2-be84-f419abf210e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:54.842644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56350d5c-0af4-46b2-be84-f419abf210e9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:54.931322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:54.934485 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcfe79-7376-4e3b-a5b0-79d69af24836 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:54.966174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:54.972676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd2ca-0773-4b37-a2eb-2d3df1f9586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:54.973467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd2ca-0773-4b37-a2eb-2d3df1f9586f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:54.973872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd2ca-0773-4b37-a2eb-2d3df1f9586f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:54.974252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd2ca-0773-4b37-a2eb-2d3df1f9586f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:54.981823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd2ca-0773-4b37-a2eb-2d3df1f9586f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:54.983516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd2ca-0773-4b37-a2eb-2d3df1f9586f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:54.987620 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 236/474] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:54.988496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56350d5c-0af4-46b2-be84-f419abf210e9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-9fcfd2ca-0773-4b37-a2eb-2d3df1f9586f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:55.001594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:55.002531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:55.003697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:55.003697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:55.003697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:55.003697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:55.003697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:55.003697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:55.003697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:55.003697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:55.003697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 239/475] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:55.004303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd2ca-0773-4b37-a2eb-2d3df1f9586f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.104095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56350d5c-0af4-46b2-be84-f419abf210e9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:55.135516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd2ca-0773-4b37-a2eb-2d3df1f9586f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:55.146026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959dcb8-d6a3-4831-a481-08dd6984d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:55.147429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959dcb8-d6a3-4831-a481-08dd6984d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.147713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959dcb8-d6a3-4831-a481-08dd6984d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.147979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959dcb8-d6a3-4831-a481-08dd6984d9f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.158810 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959dcb8-d6a3-4831-a481-08dd6984d9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:55.160308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959dcb8-d6a3-4831-a481-08dd6984d9f2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:55.172065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9829f71-ab2c-42ca-be1b-42896aced0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:55.172699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9829f71-ab2c-42ca-be1b-42896aced0ac None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.173032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9829f71-ab2c-42ca-be1b-42896aced0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.173303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9829f71-ab2c-42ca-be1b-42896aced0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-a959dcb8-d6a3-4831-a481-08dd6984d9f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:55.176142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:55.177022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:55.182970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:55.182970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:55.182970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:55.182970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 237/476] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:55.182970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959dcb8-d6a3-4831-a481-08dd6984d9f2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.184470 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9829f71-ab2c-42ca-be1b-42896aced0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:55.185939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9829f71-ab2c-42ca-be1b-42896aced0ac None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f9829f71-ab2c-42ca-be1b-42896aced0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:55.201340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:55.202283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:55.203163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:55.203163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:55.203163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:55.203163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 240/477] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:55.203922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5caf-29ba-416e-90a4-c8787771f7cd None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.204018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5caf-29ba-416e-90a4-c8787771f7cd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.204300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5caf-29ba-416e-90a4-c8787771f7cd None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.206433 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 241/478] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:55.212401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5caf-29ba-416e-90a4-c8787771f7cd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.227228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:55.231158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:55.299019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959dcb8-d6a3-4831-a481-08dd6984d9f2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:55.328141 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5caf-29ba-416e-90a4-c8787771f7cd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:55.337072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866d09-2ef3-4596-99c0-d8e1547581b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:55.337887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866d09-2ef3-4596-99c0-d8e1547581b7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.338297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866d09-2ef3-4596-99c0-d8e1547581b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.338736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866d09-2ef3-4596-99c0-d8e1547581b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.339617 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866d09-2ef3-4596-99c0-d8e1547581b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:55.340051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866d09-2ef3-4596-99c0-d8e1547581b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:55.341619 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866d09-2ef3-4596-99c0-d8e1547581b7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:55.359100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 238/479] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:55.360488 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866d09-2ef3-4596-99c0-d8e1547581b7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.365623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4add412-508c-454b-9831-0b2b7c0e3b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:55.366219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4add412-508c-454b-9831-0b2b7c0e3b3b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.366491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4add412-508c-454b-9831-0b2b7c0e3b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.366750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4add412-508c-454b-9831-0b2b7c0e3b3b None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.367412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4add412-508c-454b-9831-0b2b7c0e3b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:55.367706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4add412-508c-454b-9831-0b2b7c0e3b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:55.369074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4add412-508c-454b-9831-0b2b7c0e3b3b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:55.383896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 242/480] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:55.383896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c53a-e12a-4c8c-98e0-337f364a6a33 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.383896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c53a-e12a-4c8c-98e0-337f364a6a33 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.388239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c53a-e12a-4c8c-98e0-337f364a6a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.407074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2640c53a-e12a-4c8c-98e0-337f364a6a33 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:55.408259 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2640c53a-e12a-4c8c-98e0-337f364a6a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:55.469563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:55.475837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866d09-2ef3-4596-99c0-d8e1547581b7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:55.488090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 243/481] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:55.489183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c53a-e12a-4c8c-98e0-337f364a6a33 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.492055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:55.519898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97318-fb14-43d3-a668-4bd2db3ecef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:55.520758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97318-fb14-43d3-a668-4bd2db3ecef3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.521234 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97318-fb14-43d3-a668-4bd2db3ecef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.521826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97318-fb14-43d3-a668-4bd2db3ecef3 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.522684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97318-fb14-43d3-a668-4bd2db3ecef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:55.523171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97318-fb14-43d3-a668-4bd2db3ecef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:55.524792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97318-fb14-43d3-a668-4bd2db3ecef3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:55.543081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 239/482] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:55.544216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97318-fb14-43d3-a668-4bd2db3ecef3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.624974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c53a-e12a-4c8c-98e0-337f364a6a33 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:55.662773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97318-fb14-43d3-a668-4bd2db3ecef3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:55.666704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9e687-d58f-4477-801b-7abbce58534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:55.666704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9e687-d58f-4477-801b-7abbce58534a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.666956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9e687-d58f-4477-801b-7abbce58534a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.667309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9e687-d58f-4477-801b-7abbce58534a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.668095 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9e687-d58f-4477-801b-7abbce58534a None admin] RBAC: Adding query filter params (role.id=69a1febe83c9483cb6175c815d7e4f8e, scope.project.id=11342796e85b428195cf5155b512162c, user.id=68d8ec9210f54c6698477d7dbbe46a2d) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:55.668483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9e687-d58f-4477-801b-7abbce58534a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:55.670064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9e687-d58f-4477-801b-7abbce58534a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:55.682962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 244/483] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/role_assignments?user.id=68d8ec9210f54c6698477d7dbbe46a2d&scope.project.id=11342796e85b428195cf5155b512162c&role.id=69a1febe83c9483cb6175c815d7e4f8e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:55.682962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9e687-d58f-4477-801b-7abbce58534a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.734517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3941602-6e2d-4222-a9b8-ef39df75b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:55.735191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3941602-6e2d-4222-a9b8-ef39df75b343 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.735465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3941602-6e2d-4222-a9b8-ef39df75b343 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.735733 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3941602-6e2d-4222-a9b8-ef39df75b343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.746908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3941602-6e2d-4222-a9b8-ef39df75b343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:55.748542 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3941602-6e2d-4222-a9b8-ef39df75b343 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e3941602-6e2d-4222-a9b8-ef39df75b343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:55.774418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:55.775376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:55.776216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:55.776216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:55.776216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:55.776216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:55.776216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:55.776216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:55.776216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:55.776216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:55.780814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 240/484] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:55.781842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3941602-6e2d-4222-a9b8-ef39df75b343 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.803125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:55.803551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:55.845818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9e687-d58f-4477-801b-7abbce58534a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:55.885099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843de656-78ab-440c-b6f4-7156a69b61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:55.885926 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843de656-78ab-440c-b6f4-7156a69b61e5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.886358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843de656-78ab-440c-b6f4-7156a69b61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.886703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843de656-78ab-440c-b6f4-7156a69b61e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.894232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843de656-78ab-440c-b6f4-7156a69b61e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:55.895852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843de656-78ab-440c-b6f4-7156a69b61e5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:55.903200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3941602-6e2d-4222-a9b8-ef39df75b343 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-843de656-78ab-440c-b6f4-7156a69b61e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:55.907950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:55.908779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:55.909615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:55.909615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:55.909615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:55.909615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:55.909615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:55.909615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:55.909615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:55.909615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:55.909615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 245/485] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:55.910066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843de656-78ab-440c-b6f4-7156a69b61e5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:55.951199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb56332-7c31-4669-8d97-c60ad2037021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:55.951836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb56332-7c31-4669-8d97-c60ad2037021 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:55.952105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb56332-7c31-4669-8d97-c60ad2037021 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:55.952449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb56332-7c31-4669-8d97-c60ad2037021 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:55.964435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb56332-7c31-4669-8d97-c60ad2037021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-4fb56332-7c31-4669-8d97-c60ad2037021 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:55.969715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:55.976130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 241/486] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:55.976916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb56332-7c31-4669-8d97-c60ad2037021 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:56.039567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843de656-78ab-440c-b6f4-7156a69b61e5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:56.061603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:56.074335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:56.078150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106918-cf33-43fd-a942-f05c2c3fd91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:56.078977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106918-cf33-43fd-a942-f05c2c3fd91f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.079457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106918-cf33-43fd-a942-f05c2c3fd91f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.079865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106918-cf33-43fd-a942-f05c2c3fd91f None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.080818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106918-cf33-43fd-a942-f05c2c3fd91f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:56.081253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106918-cf33-43fd-a942-f05c2c3fd91f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:56.083042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106918-cf33-43fd-a942-f05c2c3fd91f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:56.088820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb56332-7c31-4669-8d97-c60ad2037021 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:56.096516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 246/487] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:56.097631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106918-cf33-43fd-a942-f05c2c3fd91f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:56.129678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec8b91-82b3-4cd6-9c10-581a7b0ed190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:56.130489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec8b91-82b3-4cd6-9c10-581a7b0ed190 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.130947 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec8b91-82b3-4cd6-9c10-581a7b0ed190 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.131330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec8b91-82b3-4cd6-9c10-581a7b0ed190 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.132227 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec8b91-82b3-4cd6-9c10-581a7b0ed190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:56.132628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec8b91-82b3-4cd6-9c10-581a7b0ed190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:56.135540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec8b91-82b3-4cd6-9c10-581a7b0ed190 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:56.155013 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 242/488] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:56.156111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec8b91-82b3-4cd6-9c10-581a7b0ed190 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:56.207895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106918-cf33-43fd-a942-f05c2c3fd91f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:56.244230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ace01-27a7-4213-afea-f37d2568711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:56.245241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ace01-27a7-4213-afea-f37d2568711b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.245714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ace01-27a7-4213-afea-f37d2568711b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.246168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ace01-27a7-4213-afea-f37d2568711b None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.247059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ace01-27a7-4213-afea-f37d2568711b None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:56.247573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ace01-27a7-4213-afea-f37d2568711b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:56.249208 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ace01-27a7-4213-afea-f37d2568711b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:56.265272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 247/489] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:29:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:56.266600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ace01-27a7-4213-afea-f37d2568711b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:56.275899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec8b91-82b3-4cd6-9c10-581a7b0ed190 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:56.319754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a366de-5f77-4e54-b0e1-bea8e6b78f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:56.320343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a366de-5f77-4e54-b0e1-bea8e6b78f85 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.320544 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a366de-5f77-4e54-b0e1-bea8e6b78f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.320939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a366de-5f77-4e54-b0e1-bea8e6b78f85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.321677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a366de-5f77-4e54-b0e1-bea8e6b78f85 None admin] RBAC: Adding query filter params (role.id=69a1febe83c9483cb6175c815d7e4f8e, scope.project.id=11342796e85b428195cf5155b512162c, user.id=fe801da792944be2b6342c483bcb88b6) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:56.321984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a366de-5f77-4e54-b0e1-bea8e6b78f85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:56.323605 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:56.324677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a366de-5f77-4e54-b0e1-bea8e6b78f85 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:56.328363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:56.334574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 243/490] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:56 2022] GET /identity/v3/role_assignments?user.id=fe801da792944be2b6342c483bcb88b6&scope.project.id=11342796e85b428195cf5155b512162c&role.id=69a1febe83c9483cb6175c815d7e4f8e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:56.335765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a366de-5f77-4e54-b0e1-bea8e6b78f85 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:56.386667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ace01-27a7-4213-afea-f37d2568711b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:56.426401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144a0f-b359-40a8-beab-f614a74d4f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:56.435737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144a0f-b359-40a8-beab-f614a74d4f72 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.436395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144a0f-b359-40a8-beab-f614a74d4f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.436831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144a0f-b359-40a8-beab-f614a74d4f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.437808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144a0f-b359-40a8-beab-f614a74d4f72 None admin] RBAC: Adding query filter params (role.id=69a1febe83c9483cb6175c815d7e4f8e, scope.project.id=11342796e85b428195cf5155b512162c, user.id=37c812964d514d3f8082f90d0f512246) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:56.438300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144a0f-b359-40a8-beab-f614a74d4f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:56.440134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144a0f-b359-40a8-beab-f614a74d4f72 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:56.460432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 248/491] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:56 2022] GET /identity/v3/role_assignments?user.id=37c812964d514d3f8082f90d0f512246&scope.project.id=11342796e85b428195cf5155b512162c&role.id=69a1febe83c9483cb6175c815d7e4f8e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:56.471591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a366de-5f77-4e54-b0e1-bea8e6b78f85 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:56.529900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a9e8c-7598-448b-bbd8-62b2b31ad33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:56.530576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9e8c-7598-448b-bbd8-62b2b31ad33f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.530902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9e8c-7598-448b-bbd8-62b2b31ad33f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.531198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9e8c-7598-448b-bbd8-62b2b31ad33f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.548575 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9e8c-7598-448b-bbd8-62b2b31ad33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:56.550198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9e8c-7598-448b-bbd8-62b2b31ad33f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b40a9e8c-7598-448b-bbd8-62b2b31ad33f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:56.567497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:56.568480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:56.569979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:56.569979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:56.569979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:56.569979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 244/492] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:56.576905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144a0f-b359-40a8-beab-f614a74d4f72 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:56.703057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144a0f-b359-40a8-beab-f614a74d4f72 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:56.719310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:56.747019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaa264-f9d2-4821-9ed5-6a70fef439db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:56.747641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaa264-f9d2-4821-9ed5-6a70fef439db None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.747919 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaa264-f9d2-4821-9ed5-6a70fef439db None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.748187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaa264-f9d2-4821-9ed5-6a70fef439db None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.748834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaa264-f9d2-4821-9ed5-6a70fef439db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:56.749133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaa264-f9d2-4821-9ed5-6a70fef439db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:56.750532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaa264-f9d2-4821-9ed5-6a70fef439db None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:56.764028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 249/493] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:56.769437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a9e8c-7598-448b-bbd8-62b2b31ad33f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:56.814274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc08de-ea08-4596-824d-1c0edf8b924e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.814612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc08de-ea08-4596-824d-1c0edf8b924e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.814885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc08de-ea08-4596-824d-1c0edf8b924e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.817067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 250/494] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:56.831041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:56.831223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ce1b5-fc23-41af-9c89-9c055b50253a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.831573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ce1b5-fc23-41af-9c89-9c055b50253a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.831954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ce1b5-fc23-41af-9c89-9c055b50253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.852347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-926ce1b5-fc23-41af-9c89-9c055b50253a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:56.853797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-926ce1b5-fc23-41af-9c89-9c055b50253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:56.889372 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a9e8c-7598-448b-bbd8-62b2b31ad33f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:56.930291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a19e0d-8b8c-4869-9d6d-1b3853f5b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:56.930964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a19e0d-8b8c-4869-9d6d-1b3853f5b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:56.931230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a19e0d-8b8c-4869-9d6d-1b3853f5b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:56.931502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a19e0d-8b8c-4869-9d6d-1b3853f5b6b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:56.938868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 251/495] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:29:56.945078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a19e0d-8b8c-4869-9d6d-1b3853f5b6b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:56.946561 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a19e0d-8b8c-4869-9d6d-1b3853f5b6b9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-48a19e0d-8b8c-4869-9d6d-1b3853f5b6b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:56.958459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:56.959582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:56.960670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 245/496] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:29:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:56.967000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ce1b5-fc23-41af-9c89-9c055b50253a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:57.081396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ce1b5-fc23-41af-9c89-9c055b50253a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:57.082832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:57.132212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e31e2b-2684-44b0-9f88-68102ea25d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:57.132831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31e2b-2684-44b0-9f88-68102ea25d2d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:57.133106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31e2b-2684-44b0-9f88-68102ea25d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:57.133376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31e2b-2684-44b0-9f88-68102ea25d2d None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:57.134106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31e2b-2684-44b0-9f88-68102ea25d2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:57.134406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31e2b-2684-44b0-9f88-68102ea25d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:57.135890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31e2b-2684-44b0-9f88-68102ea25d2d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:57.155275 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 252/497] 10.222.0.46 () {56 vars in 1135 bytes} [Mon Oct 24 13:29:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:57.164120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a19e0d-8b8c-4869-9d6d-1b3853f5b6b9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:57.295637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a19e0d-8b8c-4869-9d6d-1b3853f5b6b9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:57.309343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:57.330680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6ea7f-8fa5-43ca-8f81-e4d463372199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:57.331330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6ea7f-8fa5-43ca-8f81-e4d463372199 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:57.331666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6ea7f-8fa5-43ca-8f81-e4d463372199 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:57.331886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6ea7f-8fa5-43ca-8f81-e4d463372199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:57.352012 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e31e2b-2684-44b0-9f88-68102ea25d2d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:57.411337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6ea7f-8fa5-43ca-8f81-e4d463372199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:57.413392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6ea7f-8fa5-43ca-8f81-e4d463372199 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:57.569025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e31e2b-2684-44b0-9f88-68102ea25d2d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:57.592496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 246/498] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:57.597972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6ea7f-8fa5-43ca-8f81-e4d463372199 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:57.623281 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:57.645363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e30930-c9b0-4d59-b4a4-4392c7128ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:57.646014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e30930-c9b0-4d59-b4a4-4392c7128ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:57.646323 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e30930-c9b0-4d59-b4a4-4392c7128ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:57.646636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e30930-c9b0-4d59-b4a4-4392c7128ed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:57.670099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e30930-c9b0-4d59-b4a4-4392c7128ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-e3e30930-c9b0-4d59-b4a4-4392c7128ed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:29:57.675210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:57.676195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:57.677017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 253/499] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:29:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:57.696870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e30930-c9b0-4d59-b4a4-4392c7128ed3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:57.743312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:57.748710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6ea7f-8fa5-43ca-8f81-e4d463372199 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:57.789149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1550d7-3378-4b99-8b44-7221cb65bc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:57.790238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1550d7-3378-4b99-8b44-7221cb65bc88 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:57.790521 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1550d7-3378-4b99-8b44-7221cb65bc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:57.791158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1550d7-3378-4b99-8b44-7221cb65bc88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:57.802280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1550d7-3378-4b99-8b44-7221cb65bc88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:57.805726 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1550d7-3378-4b99-8b44-7221cb65bc88 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-df1550d7-3378-4b99-8b44-7221cb65bc88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:57.835052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:57.836161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:57.837747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:57.837747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:57.837747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:57.839766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 247/500] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:57.845294 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1550d7-3378-4b99-8b44-7221cb65bc88 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:57.919634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e30930-c9b0-4d59-b4a4-4392c7128ed3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:57.967281 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:57.987062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fa179-066b-4af1-a3a5-c77b0dba2d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:57.987774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fa179-066b-4af1-a3a5-c77b0dba2d8a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:57.988137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fa179-066b-4af1-a3a5-c77b0dba2d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:57.988468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fa179-066b-4af1-a3a5-c77b0dba2d8a None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:57.989200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fa179-066b-4af1-a3a5-c77b0dba2d8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:57.989498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fa179-066b-4af1-a3a5-c77b0dba2d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:57.993222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fa179-066b-4af1-a3a5-c77b0dba2d8a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:58.007017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 254/501] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:29:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:29:58.014184 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fa179-066b-4af1-a3a5-c77b0dba2d8a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:58.044501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1550d7-3378-4b99-8b44-7221cb65bc88 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:58.119887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcec75-8aee-4ed7-8ab2-6193617864d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:58.120439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcec75-8aee-4ed7-8ab2-6193617864d3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:58.120983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcec75-8aee-4ed7-8ab2-6193617864d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:58.121267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcec75-8aee-4ed7-8ab2-6193617864d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:58.121932 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcec75-8aee-4ed7-8ab2-6193617864d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:58.122234 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcec75-8aee-4ed7-8ab2-6193617864d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:58.123807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcec75-8aee-4ed7-8ab2-6193617864d3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:58.133858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:58.146597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fa179-066b-4af1-a3a5-c77b0dba2d8a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:58.161295 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 248/502] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:58.176472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcec75-8aee-4ed7-8ab2-6193617864d3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:58.187857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53261815-bb10-4077-b226-622ca7001788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:58.188491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53261815-bb10-4077-b226-622ca7001788 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:58.188764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53261815-bb10-4077-b226-622ca7001788 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:58.189029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53261815-bb10-4077-b226-622ca7001788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:58.201075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53261815-bb10-4077-b226-622ca7001788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:58.202608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53261815-bb10-4077-b226-622ca7001788 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-53261815-bb10-4077-b226-622ca7001788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:58.218130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:58.219239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:58.220690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:58.220690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:58.220690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:58.220690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 255/503] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:58.225124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53261815-bb10-4077-b226-622ca7001788 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:58.319212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcec75-8aee-4ed7-8ab2-6193617864d3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:58.342971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53261815-bb10-4077-b226-622ca7001788 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:58.345112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:58.357783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480e01-2ffa-4179-b2ac-b245eb7102e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:58.358524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480e01-2ffa-4179-b2ac-b245eb7102e3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:58.358804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480e01-2ffa-4179-b2ac-b245eb7102e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:58.359107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480e01-2ffa-4179-b2ac-b245eb7102e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:58.366704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62480e01-2ffa-4179-b2ac-b245eb7102e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:58.368259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62480e01-2ffa-4179-b2ac-b245eb7102e3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-62480e01-2ffa-4179-b2ac-b245eb7102e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:58.380659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:58.382740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:58.384849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:58.384849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:58.384849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:58.384849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:58.384849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:58.384849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:58.384849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:58.384849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:58.390987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 249/504] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:58.390987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd9904-4fb9-42c8-adf2-98dfaf5dd4dc None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:58.390987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd9904-4fb9-42c8-adf2-98dfaf5dd4dc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:58.390987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd9904-4fb9-42c8-adf2-98dfaf5dd4dc None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:58.390987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 250/505] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:58.392230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd9904-4fb9-42c8-adf2-98dfaf5dd4dc None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:58.395267 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a7938-ebce-43cd-bf1c-f1accfee21b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:58.397501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a7938-ebce-43cd-bf1c-f1accfee21b8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:58.397501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a7938-ebce-43cd-bf1c-f1accfee21b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:58.397501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a7938-ebce-43cd-bf1c-f1accfee21b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:58.397501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a7938-ebce-43cd-bf1c-f1accfee21b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:58.397811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a7938-ebce-43cd-bf1c-f1accfee21b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:58.400136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a7938-ebce-43cd-bf1c-f1accfee21b8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:58.402167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:58.422077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 256/506] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:58.423478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608ed3-0350-411d-a342-eb68025e7d93 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:58.423798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608ed3-0350-411d-a342-eb68025e7d93 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:58.424078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608ed3-0350-411d-a342-eb68025e7d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:58.442686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-28608ed3-0350-411d-a342-eb68025e7d93 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:58.443995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-28608ed3-0350-411d-a342-eb68025e7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:58.518960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 257/507] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:58.518960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608ed3-0350-411d-a342-eb68025e7d93 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:58.542248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd9904-4fb9-42c8-adf2-98dfaf5dd4dc None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:58.608450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e92f7-9edc-4555-b5e6-468f51071340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:58.610289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e92f7-9edc-4555-b5e6-468f51071340 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:58.611785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e92f7-9edc-4555-b5e6-468f51071340 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:58.612203 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e92f7-9edc-4555-b5e6-468f51071340 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:58.613229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e92f7-9edc-4555-b5e6-468f51071340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:58.616851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e92f7-9edc-4555-b5e6-468f51071340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:58.618633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e92f7-9edc-4555-b5e6-468f51071340 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:58.638524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 251/508] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:58.656389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e92f7-9edc-4555-b5e6-468f51071340 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:58.713072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608ed3-0350-411d-a342-eb68025e7d93 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:58.744994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:58.748615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:58.767614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fcacf-4fc9-4a6f-a78d-009fbafe0a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:58.768586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fcacf-4fc9-4a6f-a78d-009fbafe0a5d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:58.769035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fcacf-4fc9-4a6f-a78d-009fbafe0a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:58.769484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fcacf-4fc9-4a6f-a78d-009fbafe0a5d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:58.784338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fcacf-4fc9-4a6f-a78d-009fbafe0a5d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:58.789733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fcacf-4fc9-4a6f-a78d-009fbafe0a5d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-174fcacf-4fc9-4a6f-a78d-009fbafe0a5d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:29:58.813838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:58.815058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:29:58.816113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:58.820445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 258/509] 10.222.0.46 () {56 vars in 1093 bytes} [Mon Oct 24 13:29:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:58.828181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fcacf-4fc9-4a6f-a78d-009fbafe0a5d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:58.865985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e92f7-9edc-4555-b5e6-468f51071340 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:58.915571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c784-4094-4131-b647-ec610f82124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:58.916273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c784-4094-4131-b647-ec610f82124a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:58.916640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c784-4094-4131-b647-ec610f82124a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:58.917001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c784-4094-4131-b647-ec610f82124a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:58.917836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c784-4094-4131-b647-ec610f82124a None admin] RBAC: Adding query filter params (role.id=69a1febe83c9483cb6175c815d7e4f8e, scope.project.id=11342796e85b428195cf5155b512162c, user.id=28110c7825734d229ac61878eacbe49e) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:58.918241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c784-4094-4131-b647-ec610f82124a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:58.919833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c784-4094-4131-b647-ec610f82124a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:58.926992 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 252/510] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:29:58 2022] GET /identity/v3/role_assignments?user.id=28110c7825734d229ac61878eacbe49e&scope.project.id=11342796e85b428195cf5155b512162c&role.id=69a1febe83c9483cb6175c815d7e4f8e => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:58.929075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c784-4094-4131-b647-ec610f82124a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:58.978536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fcacf-4fc9-4a6f-a78d-009fbafe0a5d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:59.018583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae9513-ec4c-4735-b311-a0c1dac79c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:59.019477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae9513-ec4c-4735-b311-a0c1dac79c2b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.019925 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae9513-ec4c-4735-b311-a0c1dac79c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.020339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae9513-ec4c-4735-b311-a0c1dac79c2b None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.021631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae9513-ec4c-4735-b311-a0c1dac79c2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:59.022173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae9513-ec4c-4735-b311-a0c1dac79c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:59.023902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae9513-ec4c-4735-b311-a0c1dac79c2b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:59.046820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 259/511] 10.222.0.46 () {56 vars in 1133 bytes} [Mon Oct 24 13:29:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:59.051177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c784-4094-4131-b647-ec610f82124a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:59.053704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae9513-ec4c-4735-b311-a0c1dac79c2b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:59.062357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:59.097379 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d33cc9-85b4-4e7b-a377-34ad783c82c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:59.098191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33cc9-85b4-4e7b-a377-34ad783c82c2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.098470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33cc9-85b4-4e7b-a377-34ad783c82c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.098739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33cc9-85b4-4e7b-a377-34ad783c82c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.110446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:59.116761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d33cc9-85b4-4e7b-a377-34ad783c82c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:59.118262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d33cc9-85b4-4e7b-a377-34ad783c82c2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-01d33cc9-85b4-4e7b-a377-34ad783c82c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:59.138888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:59.139965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:59.140904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:59.140904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:59.140904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:59.140904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 253/512] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:59.141812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f904d1-dad7-4e63-adba-38bdfca22e65 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.142072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f904d1-dad7-4e63-adba-38bdfca22e65 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.142341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f904d1-dad7-4e63-adba-38bdfca22e65 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.148010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 254/513] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:59.150801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f904d1-dad7-4e63-adba-38bdfca22e65 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:59.199648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae9513-ec4c-4735-b311-a0c1dac79c2b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:59.247460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e170f8-3443-4dce-84c4-0deb873a60a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:59.248499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e170f8-3443-4dce-84c4-0deb873a60a8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.248917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e170f8-3443-4dce-84c4-0deb873a60a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.249286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e170f8-3443-4dce-84c4-0deb873a60a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.261183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e170f8-3443-4dce-84c4-0deb873a60a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:59.262851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e170f8-3443-4dce-84c4-0deb873a60a8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-e6e170f8-3443-4dce-84c4-0deb873a60a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:29:59.279404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:59.280583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:29:59.281634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:29:59.281634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:29:59.281634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:59.284877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f904d1-dad7-4e63-adba-38bdfca22e65 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:59.285861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 260/514] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:59.287224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c2196-2264-4a3e-9053-dd848d3bbce8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.287502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c2196-2264-4a3e-9053-dd848d3bbce8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.287924 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c2196-2264-4a3e-9053-dd848d3bbce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.307290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8c5c2196-2264-4a3e-9053-dd848d3bbce8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:59.309068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8c5c2196-2264-4a3e-9053-dd848d3bbce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:59.320324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9ceea-5a53-464c-8092-0d1ee7bed77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:59.321009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9ceea-5a53-464c-8092-0d1ee7bed77c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.321285 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9ceea-5a53-464c-8092-0d1ee7bed77c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.321548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9ceea-5a53-464c-8092-0d1ee7bed77c None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.322189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9ceea-5a53-464c-8092-0d1ee7bed77c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:59.322487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9ceea-5a53-464c-8092-0d1ee7bed77c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:59.323928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9ceea-5a53-464c-8092-0d1ee7bed77c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:59.340920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 255/515] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:59.340920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284f044-6db0-4aad-9a98-82d9c5d512f2 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.340920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284f044-6db0-4aad-9a98-82d9c5d512f2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.340920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284f044-6db0-4aad-9a98-82d9c5d512f2 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.340920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 256/516] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:29:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:29:59.340920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284f044-6db0-4aad-9a98-82d9c5d512f2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:59.363802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:59.400414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 261/517] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:59.406981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c2196-2264-4a3e-9053-dd848d3bbce8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:59.440131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:59.465347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284f044-6db0-4aad-9a98-82d9c5d512f2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:59.515483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c017f-d874-456d-a26d-52e8d5eae123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:59.517110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c017f-d874-456d-a26d-52e8d5eae123 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.517739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c017f-d874-456d-a26d-52e8d5eae123 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.518272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c017f-d874-456d-a26d-52e8d5eae123 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.519354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c017f-d874-456d-a26d-52e8d5eae123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:29:59.519825 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c017f-d874-456d-a26d-52e8d5eae123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:59.522183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c017f-d874-456d-a26d-52e8d5eae123 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:59.523632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c2196-2264-4a3e-9053-dd848d3bbce8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:59.538204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 257/518] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:29:59.540516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c475e-d284-4414-a2e7-c0758f5519fc None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.541209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c475e-d284-4414-a2e7-c0758f5519fc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.541648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c475e-d284-4414-a2e7-c0758f5519fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.561478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859a649-ce0c-4935-bae8-48ae4bdce4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:59.562178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859a649-ce0c-4935-bae8-48ae4bdce4f4 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.562550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859a649-ce0c-4935-bae8-48ae4bdce4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.562885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859a649-ce0c-4935-bae8-48ae4bdce4f4 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.563676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859a649-ce0c-4935-bae8-48ae4bdce4f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:59.565261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859a649-ce0c-4935-bae8-48ae4bdce4f4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:59.566445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ee4c475e-d284-4414-a2e7-c0758f5519fc None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:29:59.567971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ee4c475e-d284-4414-a2e7-c0758f5519fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:29:59.598952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 262/519] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:29:59 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:29:59.598952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859a649-ce0c-4935-bae8-48ae4bdce4f4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:59.689023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 258/520] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:59.689984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c475e-d284-4414-a2e7-c0758f5519fc None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:59.703904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:59.755530 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:59.786530 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859a649-ce0c-4935-bae8-48ae4bdce4f4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:59.835977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ea678-dcd2-45a6-b895-9f564a4a5590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:59.837178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ea678-dcd2-45a6-b895-9f564a4a5590 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.837456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ea678-dcd2-45a6-b895-9f564a4a5590 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.837867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ea678-dcd2-45a6-b895-9f564a4a5590 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.847369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ea678-dcd2-45a6-b895-9f564a4a5590 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:59.849157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ea678-dcd2-45a6-b895-9f564a4a5590 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:59.860203 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c475e-d284-4414-a2e7-c0758f5519fc None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2a3ea678-dcd2-45a6-b895-9f564a4a5590 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:29:59.863528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:59.864396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:59.865539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:29:59.865539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:29:59.865539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:29:59.865539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:29:59.865539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:29:59.865539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:29:59.865539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:29:59.865539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:29:59.865539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 263/521] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:59.870410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ea678-dcd2-45a6-b895-9f564a4a5590 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:59.898003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de2a2-1a56-4d78-bc5d-8dc4b3322daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:29:59.898642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de2a2-1a56-4d78-bc5d-8dc4b3322daf None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:29:59.899148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de2a2-1a56-4d78-bc5d-8dc4b3322daf None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:29:59.899253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de2a2-1a56-4d78-bc5d-8dc4b3322daf None admin] PATH_INFO: `/v3/services/network` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:29:59.899773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07de2a2-1a56-4d78-bc5d-8dc4b3322daf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:29:59.901133 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07de2a2-1a56-4d78-bc5d-8dc4b3322daf None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-a07de2a2-1a56-4d78-bc5d-8dc4b3322daf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:29:59.914308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:29:59.915371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:29:59.917330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 259/522] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:29:59 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:29:59.921330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de2a2-1a56-4d78-bc5d-8dc4b3322daf None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:29:59.999835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:00.026612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de2a2-1a56-4d78-bc5d-8dc4b3322daf None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:00.035144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ea678-dcd2-45a6-b895-9f564a4a5590 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:00.066315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2ded8-d579-4d5f-a39f-c107ed2d0040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:00.067082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2ded8-d579-4d5f-a39f-c107ed2d0040 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:00.067431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2ded8-d579-4d5f-a39f-c107ed2d0040 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:00.067775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2ded8-d579-4d5f-a39f-c107ed2d0040 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:00.069052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2ded8-d579-4d5f-a39f-c107ed2d0040 None admin] RBAC: Adding query filter params (name=network) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:00.069448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2ded8-d579-4d5f-a39f-c107ed2d0040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:00.071014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2ded8-d579-4d5f-a39f-c107ed2d0040 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:00.077423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 260/523] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:29:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:00.078789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f46e5-9d4c-4d66-84ce-44ac9a12d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:00.079653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f46e5-9d4c-4d66-84ce-44ac9a12d38e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:00.080126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f46e5-9d4c-4d66-84ce-44ac9a12d38e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:00.080551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f46e5-9d4c-4d66-84ce-44ac9a12d38e None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:00.081431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f46e5-9d4c-4d66-84ce-44ac9a12d38e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:00.081891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f46e5-9d4c-4d66-84ce-44ac9a12d38e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:00.083166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2ded8-d579-4d5f-a39f-c107ed2d0040 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:00.084025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f46e5-9d4c-4d66-84ce-44ac9a12d38e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:00.094597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:00.100558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 264/524] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:00.101514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f46e5-9d4c-4d66-84ce-44ac9a12d38e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:00.212607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f46e5-9d4c-4d66-84ce-44ac9a12d38e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:00.214742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2ded8-d579-4d5f-a39f-c107ed2d0040 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:00.249157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931fb48-7303-4f5f-80ac-0a4ce7e1a6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:00.250295 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931fb48-7303-4f5f-80ac-0a4ce7e1a6bd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:00.250758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931fb48-7303-4f5f-80ac-0a4ce7e1a6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:00.251231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931fb48-7303-4f5f-80ac-0a4ce7e1a6bd None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:00.252063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931fb48-7303-4f5f-80ac-0a4ce7e1a6bd None admin] RBAC: Adding query filter params (type=network) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:00.252593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931fb48-7303-4f5f-80ac-0a4ce7e1a6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:00.254282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931fb48-7303-4f5f-80ac-0a4ce7e1a6bd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:00.258876 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2753c-03bc-4510-89d6-16064ab58e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:00.259548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2753c-03bc-4510-89d6-16064ab58e5c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:00.259821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2753c-03bc-4510-89d6-16064ab58e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:00.260088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2753c-03bc-4510-89d6-16064ab58e5c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:00.260963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2753c-03bc-4510-89d6-16064ab58e5c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:00.262340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2753c-03bc-4510-89d6-16064ab58e5c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:00.263106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 265/525] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:00.264180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931fb48-7303-4f5f-80ac-0a4ce7e1a6bd None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-bfb2753c-03bc-4510-89d6-16064ab58e5c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:00.282098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:00.283197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:30:00.284134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:00.291546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 261/526] 10.222.0.46 () {56 vars in 1129 bytes} [Mon Oct 24 13:30:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:00.295820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2753c-03bc-4510-89d6-16064ab58e5c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:00.303096 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:00.398865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:00.474659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931fb48-7303-4f5f-80ac-0a4ce7e1a6bd None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:00.518794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bbfdb-fbc0-4886-8ac1-15eb93aca5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:00.519902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bbfdb-fbc0-4886-8ac1-15eb93aca5b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:00.520377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bbfdb-fbc0-4886-8ac1-15eb93aca5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:00.521221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bbfdb-fbc0-4886-8ac1-15eb93aca5b8 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/3f5b069b5307470e96176481702d6e63/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:00.524878 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bbfdb-fbc0-4886-8ac1-15eb93aca5b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=3f5b069b5307470e96176481702d6e63, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:00.528425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bbfdb-fbc0-4886-8ac1-15eb93aca5b8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:00.530791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2753c-03bc-4510-89d6-16064ab58e5c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:00.556930 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 266/527] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:30:00 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/3f5b069b5307470e96176481702d6e63/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:30:00.583076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86b9b2-9c50-4c26-95b8-cbbe189cc759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:00.584327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b9b2-9c50-4c26-95b8-cbbe189cc759 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:00.584327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b9b2-9c50-4c26-95b8-cbbe189cc759 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:00.584601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b9b2-9c50-4c26-95b8-cbbe189cc759 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:00.585052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86b9b2-9c50-4c26-95b8-cbbe189cc759 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:00.585349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86b9b2-9c50-4c26-95b8-cbbe189cc759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:00.586855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86b9b2-9c50-4c26-95b8-cbbe189cc759 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:00.592618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 262/528] 10.222.0.46 () {56 vars in 1124 bytes} [Mon Oct 24 13:30:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:00.598671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bbfdb-fbc0-4886-8ac1-15eb93aca5b8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:00.726121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bbfdb-fbc0-4886-8ac1-15eb93aca5b8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:00.760815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:00.776714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ee2c-fd60-44e3-944a-b8afc9a8bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:00.777335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ee2c-fd60-44e3-944a-b8afc9a8bf3e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:00.777611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ee2c-fd60-44e3-944a-b8afc9a8bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:00.777877 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ee2c-fd60-44e3-944a-b8afc9a8bf3e None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:00.778508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390ee2c-fd60-44e3-944a-b8afc9a8bf3e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:00.778807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390ee2c-fd60-44e3-944a-b8afc9a8bf3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:00.780234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390ee2c-fd60-44e3-944a-b8afc9a8bf3e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:00.787389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 267/529] 10.222.0.46 () {56 vars in 1124 bytes} [Mon Oct 24 13:30:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:01.452824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3658e16-f4f5-4336-8609-955399448eb5 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:01.453352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3658e16-f4f5-4336-8609-955399448eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:01.453352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3658e16-f4f5-4336-8609-955399448eb5 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:01.454805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 263/530] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:01.460429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e927814-a8e5-451c-be04-3c7ee92cb556 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:01.460710 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e927814-a8e5-451c-be04-3c7ee92cb556 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:01.460977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e927814-a8e5-451c-be04-3c7ee92cb556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:01.485040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6e927814-a8e5-451c-be04-3c7ee92cb556 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:01.486240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6e927814-a8e5-451c-be04-3c7ee92cb556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:01.575002 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 268/531] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:30:02.004314 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3658e16-f4f5-4336-8609-955399448eb5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:02.091974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:02.148976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3658e16-f4f5-4336-8609-955399448eb5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:02.194607 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e533f4-dafc-4ced-b4d3-360461e46d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:02.195271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e533f4-dafc-4ced-b4d3-360461e46d55 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:02.195543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e533f4-dafc-4ced-b4d3-360461e46d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:02.195808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e533f4-dafc-4ced-b4d3-360461e46d55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:02.208391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e533f4-dafc-4ced-b4d3-360461e46d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-35e533f4-dafc-4ced-b4d3-360461e46d55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:02.213905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:02.214820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:02.215721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 264/532] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:30:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:02.223150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e927814-a8e5-451c-be04-3c7ee92cb556 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:02.305778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75230f4b-a682-45a0-bbdc-390705addf03 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:02.306156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75230f4b-a682-45a0-bbdc-390705addf03 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:02.306703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75230f4b-a682-45a0-bbdc-390705addf03 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:02.308317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 265/533] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:02.314901 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81a707-0dfc-4ac3-9b37-2f62fd91d790 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:02.315200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81a707-0dfc-4ac3-9b37-2f62fd91d790 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:02.315736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81a707-0dfc-4ac3-9b37-2f62fd91d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:02.353307 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9d81a707-0dfc-4ac3-9b37-2f62fd91d790 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:02.354523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9d81a707-0dfc-4ac3-9b37-2f62fd91d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:02.391384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e927814-a8e5-451c-be04-3c7ee92cb556 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:02.434770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:02.467095 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11153d44-c3ea-4250-8ace-3c125dac01ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:02.467714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11153d44-c3ea-4250-8ace-3c125dac01ac None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:02.467987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11153d44-c3ea-4250-8ace-3c125dac01ac None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:02.468251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11153d44-c3ea-4250-8ace-3c125dac01ac None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:02.468913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11153d44-c3ea-4250-8ace-3c125dac01ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:02.469209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11153d44-c3ea-4250-8ace-3c125dac01ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:02.470618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11153d44-c3ea-4250-8ace-3c125dac01ac None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:02.488383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 269/534] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:30:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:02.491124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 266/535] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:30:02.493791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11153d44-c3ea-4250-8ace-3c125dac01ac None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:02.603161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11153d44-c3ea-4250-8ace-3c125dac01ac None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:02.639102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a2ea-7ff6-47a5-b115-7de9492b5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:02.639741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a2ea-7ff6-47a5-b115-7de9492b5735 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:02.640016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a2ea-7ff6-47a5-b115-7de9492b5735 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:02.640281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a2ea-7ff6-47a5-b115-7de9492b5735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:02.652120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a2ea-7ff6-47a5-b115-7de9492b5735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:02.653590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a2ea-7ff6-47a5-b115-7de9492b5735 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2b07a2ea-7ff6-47a5-b115-7de9492b5735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:02.668677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:02.670911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:02.671907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:02.671907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:02.671907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:02.671907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 270/536] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:02.678521 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81a707-0dfc-4ac3-9b37-2f62fd91d790 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:02.739098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:02.798761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81a707-0dfc-4ac3-9b37-2f62fd91d790 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:02.838003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4cc8-8655-49e4-8999-b8e5ab417795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:02.838626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4cc8-8655-49e4-8999-b8e5ab417795 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:02.838901 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4cc8-8655-49e4-8999-b8e5ab417795 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:02.839177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4cc8-8655-49e4-8999-b8e5ab417795 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:02.839826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d4cc8-8655-49e4-8999-b8e5ab417795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:02.840118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d4cc8-8655-49e4-8999-b8e5ab417795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:02.841479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d4cc8-8655-49e4-8999-b8e5ab417795 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:02.859497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 267/537] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:02.868073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a2ea-7ff6-47a5-b115-7de9492b5735 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:02.877240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4cc8-8655-49e4-8999-b8e5ab417795 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:02.945673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:02.995224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4cc8-8655-49e4-8999-b8e5ab417795 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:03.028846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:03.067938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d0d3d-02ec-4f2e-9269-cf98af27ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:03.070011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d0d3d-02ec-4f2e-9269-cf98af27ee54 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.070782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d0d3d-02ec-4f2e-9269-cf98af27ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.071451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d0d3d-02ec-4f2e-9269-cf98af27ee54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.096611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d0d3d-02ec-4f2e-9269-cf98af27ee54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:03.101156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a2ea-7ff6-47a5-b115-7de9492b5735 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-fd5d0d3d-02ec-4f2e-9269-cf98af27ee54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:03.102861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:03.104125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:03.105163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 268/538] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:30:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:03.106049 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaa177-162a-4b29-8e14-ed9abc381585 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.106049 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaa177-162a-4b29-8e14-ed9abc381585 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.106049 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaa177-162a-4b29-8e14-ed9abc381585 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.111143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 269/539] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:03.112337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaa177-162a-4b29-8e14-ed9abc381585 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:03.148862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eb673-8f44-4f41-8f71-87d03f4696f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:03.149897 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb673-8f44-4f41-8f71-87d03f4696f7 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.150428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb673-8f44-4f41-8f71-87d03f4696f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.150890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb673-8f44-4f41-8f71-87d03f4696f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.159873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eb673-8f44-4f41-8f71-87d03f4696f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:03.161340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eb673-8f44-4f41-8f71-87d03f4696f7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-e55eb673-8f44-4f41-8f71-87d03f4696f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:03.174435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:03.175552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:03.176898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 271/540] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:30:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:03.177718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a7365-4635-452f-88a4-1d26056792d5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.177718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a7365-4635-452f-88a4-1d26056792d5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.177863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a7365-4635-452f-88a4-1d26056792d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.203622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-563a7365-4635-452f-88a4-1d26056792d5 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:03.204977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-563a7365-4635-452f-88a4-1d26056792d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:03.238955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaa177-162a-4b29-8e14-ed9abc381585 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:03.285542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 272/541] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:30:03.286420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a7365-4635-452f-88a4-1d26056792d5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:03.287614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeede7-c6b3-4610-9217-2285ad886e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:03.288413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeede7-c6b3-4610-9217-2285ad886e11 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.288753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeede7-c6b3-4610-9217-2285ad886e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.289395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeede7-c6b3-4610-9217-2285ad886e11 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.291103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeede7-c6b3-4610-9217-2285ad886e11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:03.291437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeede7-c6b3-4610-9217-2285ad886e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:03.292831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeede7-c6b3-4610-9217-2285ad886e11 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:03.305066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 270/542] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:30:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:03.310838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396831e4-e99f-482f-947f-4a178da69529 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.311146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396831e4-e99f-482f-947f-4a178da69529 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.311419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396831e4-e99f-482f-947f-4a178da69529 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.312700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 271/543] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:30:03.313380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396831e4-e99f-482f-947f-4a178da69529 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:03.316691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:03.366820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:03.413797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a7365-4635-452f-88a4-1d26056792d5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:03.444195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396831e4-e99f-482f-947f-4a178da69529 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:03.451738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bc287-ffaf-4407-aace-1f6b4744edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:03.452572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bc287-ffaf-4407-aace-1f6b4744edcc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.452991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bc287-ffaf-4407-aace-1f6b4744edcc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.453404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bc287-ffaf-4407-aace-1f6b4744edcc None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.454269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bc287-ffaf-4407-aace-1f6b4744edcc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:03.454703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bc287-ffaf-4407-aace-1f6b4744edcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:03.456326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bc287-ffaf-4407-aace-1f6b4744edcc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:03.475510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 273/544] 10.222.0.46 () {56 vars in 1135 bytes} [Mon Oct 24 13:30:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:03.477147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa6c8a-866f-47e7-833e-4befef4ff832 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.477648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa6c8a-866f-47e7-833e-4befef4ff832 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.478110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa6c8a-866f-47e7-833e-4befef4ff832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.482481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b0475-c9f4-48fa-b05e-8bcd2637a068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:03.483153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b0475-c9f4-48fa-b05e-8bcd2637a068 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.483427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b0475-c9f4-48fa-b05e-8bcd2637a068 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.483693 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b0475-c9f4-48fa-b05e-8bcd2637a068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.498267 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9bfa6c8a-866f-47e7-833e-4befef4ff832 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:03.500129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b0475-c9f4-48fa-b05e-8bcd2637a068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:03.500640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9bfa6c8a-866f-47e7-833e-4befef4ff832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:03.501585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b0475-c9f4-48fa-b05e-8bcd2637a068 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-300b0475-c9f4-48fa-b05e-8bcd2637a068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:03.520944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:03.522079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:03.522991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:03.522991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:03.522991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:03.522991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 272/545] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:03.523865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b0475-c9f4-48fa-b05e-8bcd2637a068 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:03.584844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 274/546] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:30:03.586061 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa6c8a-866f-47e7-833e-4befef4ff832 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:03.598337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:03.649309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:03.661279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b0475-c9f4-48fa-b05e-8bcd2637a068 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:03.696103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41346b27-c27b-4692-8892-4b190b137fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:03.696986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41346b27-c27b-4692-8892-4b190b137fec None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.696986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41346b27-c27b-4692-8892-4b190b137fec None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.697282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41346b27-c27b-4692-8892-4b190b137fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.702836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa6c8a-866f-47e7-833e-4befef4ff832 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:03.708451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41346b27-c27b-4692-8892-4b190b137fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:03.709897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41346b27-c27b-4692-8892-4b190b137fec None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-41346b27-c27b-4692-8892-4b190b137fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:03.724885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:03.725851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:03.726718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:03.726718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:03.726718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:03.726718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 273/547] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:03.726718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41346b27-c27b-4692-8892-4b190b137fec None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:03.743692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c645f9e-49c0-43bb-b0b5-1741a19aab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:03.744311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c645f9e-49c0-43bb-b0b5-1741a19aab14 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.744615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c645f9e-49c0-43bb-b0b5-1741a19aab14 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.744857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c645f9e-49c0-43bb-b0b5-1741a19aab14 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.745502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c645f9e-49c0-43bb-b0b5-1741a19aab14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:03.745807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c645f9e-49c0-43bb-b0b5-1741a19aab14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:03.747240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c645f9e-49c0-43bb-b0b5-1741a19aab14 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:03.763753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 275/548] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:03.763753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504cc02-0ad2-45d4-93e9-4ac255496394 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.763753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504cc02-0ad2-45d4-93e9-4ac255496394 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.763753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504cc02-0ad2-45d4-93e9-4ac255496394 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.766582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 276/549] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:03.767387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504cc02-0ad2-45d4-93e9-4ac255496394 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:03.839481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:03.846775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41346b27-c27b-4692-8892-4b190b137fec None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:03.873846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504cc02-0ad2-45d4-93e9-4ac255496394 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:03.883792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fac46-2e9c-4e88-85bd-89b1f59e7e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:03.884407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fac46-2e9c-4e88-85bd-89b1f59e7e68 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.884684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fac46-2e9c-4e88-85bd-89b1f59e7e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.884951 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fac46-2e9c-4e88-85bd-89b1f59e7e68 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.885608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fac46-2e9c-4e88-85bd-89b1f59e7e68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:03.887021 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fac46-2e9c-4e88-85bd-89b1f59e7e68 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:03.903945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 274/550] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:30:03 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:03.904688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fac46-2e9c-4e88-85bd-89b1f59e7e68 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:03.907269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:03.918910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aa928-d4d2-4d64-bbaa-3b8c82e6955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:03.919714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa928-d4d2-4d64-bbaa-3b8c82e6955c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.920055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa928-d4d2-4d64-bbaa-3b8c82e6955c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.920426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa928-d4d2-4d64-bbaa-3b8c82e6955c None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.921171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477aa928-d4d2-4d64-bbaa-3b8c82e6955c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:03.921558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477aa928-d4d2-4d64-bbaa-3b8c82e6955c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:03.923830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477aa928-d4d2-4d64-bbaa-3b8c82e6955c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:03.938150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 277/551] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:03.945406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c1840-3c0c-43bf-9cea-5375cf7d6528 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:03.945406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c1840-3c0c-43bf-9cea-5375cf7d6528 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:03.945406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c1840-3c0c-43bf-9cea-5375cf7d6528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:03.995817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b17c1840-3c0c-43bf-9cea-5375cf7d6528 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:03.998142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b17c1840-3c0c-43bf-9cea-5375cf7d6528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:04.083706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fac46-2e9c-4e88-85bd-89b1f59e7e68 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:04.089292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 278/552] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:03 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:30:04.090251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c1840-3c0c-43bf-9cea-5375cf7d6528 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:04.134751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08cfe-16d3-421c-99d0-eae5b57fcfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:04.135544 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08cfe-16d3-421c-99d0-eae5b57fcfcf None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:04.135868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08cfe-16d3-421c-99d0-eae5b57fcfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:04.136136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08cfe-16d3-421c-99d0-eae5b57fcfcf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:04.147633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd08cfe-16d3-421c-99d0-eae5b57fcfcf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:04.149400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd08cfe-16d3-421c-99d0-eae5b57fcfcf None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:04.164740 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-1cd08cfe-16d3-421c-99d0-eae5b57fcfcf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:04.164925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:04.165817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:30:04.166791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:04.171277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 275/553] 10.222.0.46 () {56 vars in 1117 bytes} [Mon Oct 24 13:30:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:04.172381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08cfe-16d3-421c-99d0-eae5b57fcfcf None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:04.245739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c1840-3c0c-43bf-9cea-5375cf7d6528 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:04.265808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:04.313324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1506cee-10f8-41b4-932a-623e88dfa7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:04.314787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1506cee-10f8-41b4-932a-623e88dfa7ac None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:04.317288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1506cee-10f8-41b4-932a-623e88dfa7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:04.318570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1506cee-10f8-41b4-932a-623e88dfa7ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:04.330056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08cfe-16d3-421c-99d0-eae5b57fcfcf None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:04.334385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1506cee-10f8-41b4-932a-623e88dfa7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b1506cee-10f8-41b4-932a-623e88dfa7ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:04.341543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:04.342534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:04.343411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:04.347052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 279/554] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:30:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:04.348166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1506cee-10f8-41b4-932a-623e88dfa7ac None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:04.397742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18c19-1706-4118-bef4-8e37321822e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:04.398968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18c19-1706-4118-bef4-8e37321822e9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:04.400835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18c19-1706-4118-bef4-8e37321822e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:04.400835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18c19-1706-4118-bef4-8e37321822e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:04.408109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac18c19-1706-4118-bef4-8e37321822e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:04.409714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac18c19-1706-4118-bef4-8e37321822e9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-fac18c19-1706-4118-bef4-8e37321822e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:04.423571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:04.424586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 276/555] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:04.430530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18c19-1706-4118-bef4-8e37321822e9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:04.485006 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1506cee-10f8-41b4-932a-623e88dfa7ac None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:04.505416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:04.525543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf8a1a-67e9-4792-85b7-78354e8d28b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:04.526499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf8a1a-67e9-4792-85b7-78354e8d28b4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:04.526763 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf8a1a-67e9-4792-85b7-78354e8d28b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:04.527053 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf8a1a-67e9-4792-85b7-78354e8d28b4 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:04.527778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf8a1a-67e9-4792-85b7-78354e8d28b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:04.528073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf8a1a-67e9-4792-85b7-78354e8d28b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:04.529505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf8a1a-67e9-4792-85b7-78354e8d28b4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:04.551587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 280/556] 10.222.0.46 () {56 vars in 1149 bytes} [Mon Oct 24 13:30:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:04.551587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf8a1a-67e9-4792-85b7-78354e8d28b4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:04.557181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18c19-1706-4118-bef4-8e37321822e9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:04.581628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:04.595677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f684aa8-26d9-4746-9b72-e72f98cdea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:04.596281 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f684aa8-26d9-4746-9b72-e72f98cdea63 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:04.596494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f684aa8-26d9-4746-9b72-e72f98cdea63 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:04.596807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f684aa8-26d9-4746-9b72-e72f98cdea63 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:04.597419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f684aa8-26d9-4746-9b72-e72f98cdea63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:04.597941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f684aa8-26d9-4746-9b72-e72f98cdea63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:04.599132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f684aa8-26d9-4746-9b72-e72f98cdea63 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:04.612414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 277/557] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:04.612414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f684aa8-26d9-4746-9b72-e72f98cdea63 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:04.657602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf8a1a-67e9-4792-85b7-78354e8d28b4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:04.692898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d94748-9af1-4e48-b12d-539c34361828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:04.693754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d94748-9af1-4e48-b12d-539c34361828 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:04.694042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d94748-9af1-4e48-b12d-539c34361828 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:04.694312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d94748-9af1-4e48-b12d-539c34361828 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:04.694996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d94748-9af1-4e48-b12d-539c34361828 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:04.696398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d94748-9af1-4e48-b12d-539c34361828 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:04.714096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 281/558] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:30:04 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:04.714478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f684aa8-26d9-4746-9b72-e72f98cdea63 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:04.715569 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d94748-9af1-4e48-b12d-539c34361828 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:04.763575 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:04.783286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94635de7-513f-4630-adff-8a5a71df04f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:04.783919 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94635de7-513f-4630-adff-8a5a71df04f1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:04.784190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94635de7-513f-4630-adff-8a5a71df04f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:04.784455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94635de7-513f-4630-adff-8a5a71df04f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:04.785160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94635de7-513f-4630-adff-8a5a71df04f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:04.785465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94635de7-513f-4630-adff-8a5a71df04f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:04.787138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94635de7-513f-4630-adff-8a5a71df04f1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:04.807811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 278/559] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:04.807811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94635de7-513f-4630-adff-8a5a71df04f1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:04.867418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d94748-9af1-4e48-b12d-539c34361828 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:04.868107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:04.906714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22870d56-746e-4047-bfe2-fae99d892723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:04.907389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22870d56-746e-4047-bfe2-fae99d892723 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:04.907664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22870d56-746e-4047-bfe2-fae99d892723 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:04.907936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22870d56-746e-4047-bfe2-fae99d892723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:04.924434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22870d56-746e-4047-bfe2-fae99d892723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:04.926670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22870d56-746e-4047-bfe2-fae99d892723 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:04.936312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94635de7-513f-4630-adff-8a5a71df04f1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-22870d56-746e-4047-bfe2-fae99d892723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:04.945289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:04.946257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:04.947223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:04.947223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:04.947223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:04.947223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 282/560] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:04.947223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22870d56-746e-4047-bfe2-fae99d892723 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:04.985939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6b4a-c086-46cd-abeb-9e4ce9f10ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:04.986904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6b4a-c086-46cd-abeb-9e4ce9f10ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:04.987211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6b4a-c086-46cd-abeb-9e4ce9f10ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:04.987734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6b4a-c086-46cd-abeb-9e4ce9f10ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:05.002694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be6b4a-c086-46cd-abeb-9e4ce9f10ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:05.004410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be6b4a-c086-46cd-abeb-9e4ce9f10ba3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-30be6b4a-c086-46cd-abeb-9e4ce9f10ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:05.022401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:05.023653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:05.024698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:05.024698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:05.024698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:05.026462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 279/561] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:05.027482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6b4a-c086-46cd-abeb-9e4ce9f10ba3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:05.066316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:05.083814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22870d56-746e-4047-bfe2-fae99d892723 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:05.121949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91793fb2-6e3b-4e99-b94f-39f76afb6fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:05.123101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793fb2-6e3b-4e99-b94f-39f76afb6fd4 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:05.123670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793fb2-6e3b-4e99-b94f-39f76afb6fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:05.124137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793fb2-6e3b-4e99-b94f-39f76afb6fd4 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/28110c7825734d229ac61878eacbe49e/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:05.126419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91793fb2-6e3b-4e99-b94f-39f76afb6fd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=28110c7825734d229ac61878eacbe49e, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:05.128310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91793fb2-6e3b-4e99-b94f-39f76afb6fd4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:05.135444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:05.146403 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6b4a-c086-46cd-abeb-9e4ce9f10ba3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:05.147256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 283/562] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:30:04 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/28110c7825734d229ac61878eacbe49e/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:30:05.156368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91793fb2-6e3b-4e99-b94f-39f76afb6fd4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:05.183704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955918fc-b565-47b2-a411-43ff2eb8e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:05.184321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955918fc-b565-47b2-a411-43ff2eb8e9ce None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:05.184615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955918fc-b565-47b2-a411-43ff2eb8e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:05.185031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955918fc-b565-47b2-a411-43ff2eb8e9ce None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:05.185790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955918fc-b565-47b2-a411-43ff2eb8e9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:05.186088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955918fc-b565-47b2-a411-43ff2eb8e9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:05.188351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955918fc-b565-47b2-a411-43ff2eb8e9ce None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:05.202489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 280/563] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:05.215566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955918fc-b565-47b2-a411-43ff2eb8e9ce None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:05.325603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91793fb2-6e3b-4e99-b94f-39f76afb6fd4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:05.364349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb8f2b-9217-4c52-a248-14d80c119e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:05.365445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb8f2b-9217-4c52-a248-14d80c119e3e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:05.366025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb8f2b-9217-4c52-a248-14d80c119e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:05.366498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb8f2b-9217-4c52-a248-14d80c119e3e None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:05.367484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb8f2b-9217-4c52-a248-14d80c119e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:05.368060 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb8f2b-9217-4c52-a248-14d80c119e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:05.369687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb8f2b-9217-4c52-a248-14d80c119e3e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:05.393150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 284/564] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:05.399317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb8f2b-9217-4c52-a248-14d80c119e3e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:05.409909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:05.455030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955918fc-b565-47b2-a411-43ff2eb8e9ce None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:05.495186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d4951-8f82-439c-bc1a-d3d1459f6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:05.495867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d4951-8f82-439c-bc1a-d3d1459f6aec None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:05.496138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d4951-8f82-439c-bc1a-d3d1459f6aec None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:05.496450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d4951-8f82-439c-bc1a-d3d1459f6aec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:05.503785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d4951-8f82-439c-bc1a-d3d1459f6aec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:05.505450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d4951-8f82-439c-bc1a-d3d1459f6aec None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:05.515748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb8f2b-9217-4c52-a248-14d80c119e3e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-279d4951-8f82-439c-bc1a-d3d1459f6aec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:05.517944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:05.518828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:05.519778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:05.519778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:05.519778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:05.519778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:05.519778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:05.519778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:05.519778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:05.519778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:05.519778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 281/565] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:05.525132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d4951-8f82-439c-bc1a-d3d1459f6aec None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:05.547797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:05.560105 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b97b4-eb6b-4ffa-a0be-efffadee2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:05.561106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b97b4-eb6b-4ffa-a0be-efffadee2e29 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:05.561607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b97b4-eb6b-4ffa-a0be-efffadee2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:05.562103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b97b4-eb6b-4ffa-a0be-efffadee2e29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:05.570248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b97b4-eb6b-4ffa-a0be-efffadee2e29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:05.572146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b97b4-eb6b-4ffa-a0be-efffadee2e29 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-4f0b97b4-eb6b-4ffa-a0be-efffadee2e29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:05.585202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:05.586212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:30:05.587206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:05.589780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 285/566] 10.222.0.46 () {56 vars in 1093 bytes} [Mon Oct 24 13:30:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:05.595678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b97b4-eb6b-4ffa-a0be-efffadee2e29 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:05.671846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:05.705254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b97b4-eb6b-4ffa-a0be-efffadee2e29 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:05.706917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d4951-8f82-439c-bc1a-d3d1459f6aec None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:05.743319 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f682adf-a2ca-454f-863a-c4d5807aeb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:05.744344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f682adf-a2ca-454f-863a-c4d5807aeb5f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:05.744820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f682adf-a2ca-454f-863a-c4d5807aeb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:05.745286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f682adf-a2ca-454f-863a-c4d5807aeb5f None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:05.746321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f682adf-a2ca-454f-863a-c4d5807aeb5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:05.746818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f682adf-a2ca-454f-863a-c4d5807aeb5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:05.748494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f682adf-a2ca-454f-863a-c4d5807aeb5f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:05.768971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 286/567] 10.222.0.46 () {56 vars in 1133 bytes} [Mon Oct 24 13:30:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:05.776405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f682adf-a2ca-454f-863a-c4d5807aeb5f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:05.781403 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d6acd-8d27-4dea-b721-0080ecf12924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:05.781403 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d6acd-8d27-4dea-b721-0080ecf12924 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:05.781642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d6acd-8d27-4dea-b721-0080ecf12924 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:05.781717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d6acd-8d27-4dea-b721-0080ecf12924 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:05.782376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d6acd-8d27-4dea-b721-0080ecf12924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:05.782680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d6acd-8d27-4dea-b721-0080ecf12924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:05.784160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d6acd-8d27-4dea-b721-0080ecf12924 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:05.806500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 282/568] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:05.812120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d6acd-8d27-4dea-b721-0080ecf12924 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:05.887223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f682adf-a2ca-454f-863a-c4d5807aeb5f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:05.914339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:05.929825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eafc01-a74a-4043-8063-13e818139301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:05.929825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eafc01-a74a-4043-8063-13e818139301 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:05.930146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eafc01-a74a-4043-8063-13e818139301 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:05.930368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eafc01-a74a-4043-8063-13e818139301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:05.954778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:06.011866 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d6acd-8d27-4dea-b721-0080ecf12924 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:06.065937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eafc01-a74a-4043-8063-13e818139301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:06.067975 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eafc01-a74a-4043-8063-13e818139301 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:06.103821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c0338-131c-412e-9c12-769040feb5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:06.104524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c0338-131c-412e-9c12-769040feb5f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:06.104852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c0338-131c-412e-9c12-769040feb5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:06.105125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c0338-131c-412e-9c12-769040feb5f9 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/4c7f48b7688f4bbbb318f0ea8178d5d4/roles/69a1febe83c9483cb6175c815d7e4f8e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:06.143886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c0338-131c-412e-9c12-769040feb5f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=4c7f48b7688f4bbbb318f0ea8178d5d4, role_id=69a1febe83c9483cb6175c815d7e4f8e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:06.145827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c0338-131c-412e-9c12-769040feb5f9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:06.160514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 283/569] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:30:05 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/4c7f48b7688f4bbbb318f0ea8178d5d4/roles/69a1febe83c9483cb6175c815d7e4f8e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:30:06.188412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 287/570] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:30:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:30:06.194599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c0338-131c-412e-9c12-769040feb5f9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:06.280752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d3ce0-75d3-4e97-b163-35c4ce5e7ab7 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:06.280931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d3ce0-75d3-4e97-b163-35c4ce5e7ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:06.281212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d3ce0-75d3-4e97-b163-35c4ce5e7ab7 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:06.282776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 288/571] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:30:06.288820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52598760-e857-4f96-a959-5a21e8f45d98 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:06.289457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52598760-e857-4f96-a959-5a21e8f45d98 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:06.289927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52598760-e857-4f96-a959-5a21e8f45d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:06.317088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-52598760-e857-4f96-a959-5a21e8f45d98 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:06.318456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-52598760-e857-4f96-a959-5a21e8f45d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:06.340426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:06.353656 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c0338-131c-412e-9c12-769040feb5f9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:06.409914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:06.410386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 289/572] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:06.427156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e24503-504e-46e9-b501-0cedb9cc91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:06.428200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e24503-504e-46e9-b501-0cedb9cc91e5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:06.428545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e24503-504e-46e9-b501-0cedb9cc91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:06.428813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e24503-504e-46e9-b501-0cedb9cc91e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:06.440882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e24503-504e-46e9-b501-0cedb9cc91e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:06.442471 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e24503-504e-46e9-b501-0cedb9cc91e5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b6e24503-504e-46e9-b501-0cedb9cc91e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:06.459357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:06.460489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:06.461378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:06.461378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:06.461378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:06.461378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 284/573] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:06.467385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52598760-e857-4f96-a959-5a21e8f45d98 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:06.607178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52598760-e857-4f96-a959-5a21e8f45d98 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:06.644388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0af60-21d2-4219-813d-aea24eec493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:06.645276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0af60-21d2-4219-813d-aea24eec493a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:06.645796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0af60-21d2-4219-813d-aea24eec493a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:06.646218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0af60-21d2-4219-813d-aea24eec493a None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:06.647090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0af60-21d2-4219-813d-aea24eec493a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:06.647545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0af60-21d2-4219-813d-aea24eec493a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:06.649065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0af60-21d2-4219-813d-aea24eec493a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:06.662283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 290/574] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:06.668091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e24503-504e-46e9-b501-0cedb9cc91e5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:06.704017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0af60-21d2-4219-813d-aea24eec493a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:06.732511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:06.870258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e24503-504e-46e9-b501-0cedb9cc91e5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:06.887869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0af60-21d2-4219-813d-aea24eec493a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:06.938586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea2ea8-1d14-41dc-aaf5-79b1403b742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:06.939805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea2ea8-1d14-41dc-aaf5-79b1403b742d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:06.940231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea2ea8-1d14-41dc-aaf5-79b1403b742d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:06.941358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea2ea8-1d14-41dc-aaf5-79b1403b742d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:06.954275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea2ea8-1d14-41dc-aaf5-79b1403b742d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:06.956496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea2ea8-1d14-41dc-aaf5-79b1403b742d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:06.959642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ce1e5-4f75-4903-ad85-bdbb0bba6097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:06.960453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ce1e5-4f75-4903-ad85-bdbb0bba6097 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:06.960873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ce1e5-4f75-4903-ad85-bdbb0bba6097 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:06.961284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ce1e5-4f75-4903-ad85-bdbb0bba6097 None admin] PATH_INFO: `/v3/services/network` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:06.962593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ce1e5-4f75-4903-ad85-bdbb0bba6097 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:06.964718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ce1e5-4f75-4903-ad85-bdbb0bba6097 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f7ea2ea8-1d14-41dc-aaf5-79b1403b742d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:06.980368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:06.981361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:06.982241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:06.982241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:06.982241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:06.982241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:06.982241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:06.982241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:06.982241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:06.982241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:06.984203 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 285/575] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-e40ce1e5-4f75-4903-ad85-bdbb0bba6097 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:06.989122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:06.990255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:30:06.991248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:06.993071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea2ea8-1d14-41dc-aaf5-79b1403b742d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:06.994605 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 291/576] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:06 2022] GET /identity/v3/services/network => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:07.002009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ce1e5-4f75-4903-ad85-bdbb0bba6097 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:07.035402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:07.132746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea2ea8-1d14-41dc-aaf5-79b1403b742d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:07.170717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2847c-c3e7-4a59-afa2-382c9e1dfd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:07.174945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:07.175077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2847c-c3e7-4a59-afa2-382c9e1dfd22 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:07.175077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2847c-c3e7-4a59-afa2-382c9e1dfd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:07.175077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2847c-c3e7-4a59-afa2-382c9e1dfd22 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:07.175077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2847c-c3e7-4a59-afa2-382c9e1dfd22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:07.175077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2847c-c3e7-4a59-afa2-382c9e1dfd22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:07.176013 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2847c-c3e7-4a59-afa2-382c9e1dfd22 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:07.194174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 286/577] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:07.200474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2847c-c3e7-4a59-afa2-382c9e1dfd22 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:07.225366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ce1e5-4f75-4903-ad85-bdbb0bba6097 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:07.296714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c671b67-ed95-4114-8a4b-81b6812928b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:07.297733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c671b67-ed95-4114-8a4b-81b6812928b8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:07.297733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c671b67-ed95-4114-8a4b-81b6812928b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:07.298079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c671b67-ed95-4114-8a4b-81b6812928b8 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:07.298497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c671b67-ed95-4114-8a4b-81b6812928b8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:07.298797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c671b67-ed95-4114-8a4b-81b6812928b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:07.300347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c671b67-ed95-4114-8a4b-81b6812928b8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:07.317585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 292/578] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:07.328101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c671b67-ed95-4114-8a4b-81b6812928b8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:07.388538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:07.405483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2847c-c3e7-4a59-afa2-382c9e1dfd22 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:07.471690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdad14-e3c2-4f08-baa2-9cf151fe77e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:07.472775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdad14-e3c2-4f08-baa2-9cf151fe77e2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:07.473284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdad14-e3c2-4f08-baa2-9cf151fe77e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:07.473764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdad14-e3c2-4f08-baa2-9cf151fe77e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:07.474839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdad14-e3c2-4f08-baa2-9cf151fe77e2 None admin] RBAC: Adding query filter params (role.id=581091dd624142d3aad6710d1eb0affa, scope.project.id=11342796e85b428195cf5155b512162c, user.id=3f5b069b5307470e96176481702d6e63) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:07.475347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdad14-e3c2-4f08-baa2-9cf151fe77e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:07.477700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdad14-e3c2-4f08-baa2-9cf151fe77e2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:07.490970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c671b67-ed95-4114-8a4b-81b6812928b8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:07.491657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 287/579] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:30:07 2022] GET /identity/v3/role_assignments?user.id=3f5b069b5307470e96176481702d6e63&scope.project.id=11342796e85b428195cf5155b512162c&role.id=581091dd624142d3aad6710d1eb0affa => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:07.493297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08623e-562b-4bff-9b2c-f88091f3ee0b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:07.493827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08623e-562b-4bff-9b2c-f88091f3ee0b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:07.494434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08623e-562b-4bff-9b2c-f88091f3ee0b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:07.500134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 288/580] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:07.513330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb489-bcda-41d5-bd8c-bdb7d7344d32 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:07.513647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb489-bcda-41d5-bd8c-bdb7d7344d32 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:07.513950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb489-bcda-41d5-bd8c-bdb7d7344d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:07.529832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb6d89-4755-4535-8df9-040c869a9ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:07.537079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb6d89-4755-4535-8df9-040c869a9ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:07.537736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb6d89-4755-4535-8df9-040c869a9ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:07.538204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb6d89-4755-4535-8df9-040c869a9ff2 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:07.539135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb6d89-4755-4535-8df9-040c869a9ff2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:07.539687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb6d89-4755-4535-8df9-040c869a9ff2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:07.541383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb6d89-4755-4535-8df9-040c869a9ff2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:07.551720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 293/581] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:07.553282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ef9fb489-bcda-41d5-bd8c-bdb7d7344d32 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:07.554710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ef9fb489-bcda-41d5-bd8c-bdb7d7344d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:07.557781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb6d89-4755-4535-8df9-040c869a9ff2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:07.573540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:07.706230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 289/582] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:07.740414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb6d89-4755-4535-8df9-040c869a9ff2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:07.780322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499b1e8-8d9c-44d5-9f4b-1fc61d0717de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:07.780946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499b1e8-8d9c-44d5-9f4b-1fc61d0717de None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:07.781220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499b1e8-8d9c-44d5-9f4b-1fc61d0717de None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:07.781485 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499b1e8-8d9c-44d5-9f4b-1fc61d0717de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:07.782182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499b1e8-8d9c-44d5-9f4b-1fc61d0717de None admin] RBAC: Adding query filter params (interface=public, service_id=a678803c67d64b34b8271065ebff9ce6, region_id=RegionOne) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:07.782486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499b1e8-8d9c-44d5-9f4b-1fc61d0717de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:07.783974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499b1e8-8d9c-44d5-9f4b-1fc61d0717de None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:07.792949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 294/583] 10.222.0.46 () {56 vars in 1251 bytes} [Mon Oct 24 13:30:07 2022] GET /identity/v3/endpoints?service_id=a678803c67d64b34b8271065ebff9ce6&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:07.798381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb489-bcda-41d5-bd8c-bdb7d7344d32 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:07.900169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:07.914714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb489-bcda-41d5-bd8c-bdb7d7344d32 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:07.954757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f540b14-0f33-4b67-87d7-a936d15a82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:07.955827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f540b14-0f33-4b67-87d7-a936d15a82a7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:07.956357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f540b14-0f33-4b67-87d7-a936d15a82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:07.956827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f540b14-0f33-4b67-87d7-a936d15a82a7 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:07.957653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f540b14-0f33-4b67-87d7-a936d15a82a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:07.959315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f540b14-0f33-4b67-87d7-a936d15a82a7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:07.965672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 290/584] 10.222.0.46 () {56 vars in 1087 bytes} [Mon Oct 24 13:30:07 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:07.995920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6625d-69c4-4880-99d4-74d7d556c12f None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:07.996265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6625d-69c4-4880-99d4-74d7d556c12f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:07.996472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6625d-69c4-4880-99d4-74d7d556c12f None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:07.998145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 295/585] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:08.009340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606529d-c16f-4bf1-900b-a9c758749c09 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:08.009956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606529d-c16f-4bf1-900b-a9c758749c09 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:08.010426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606529d-c16f-4bf1-900b-a9c758749c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:08.034950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6625d-69c4-4880-99d4-74d7d556c12f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:08.036741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6606529d-c16f-4bf1-900b-a9c758749c09 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:08.038189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6606529d-c16f-4bf1-900b-a9c758749c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:08.168618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:08.170651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 291/586] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:08.218449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6625d-69c4-4880-99d4-74d7d556c12f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:08.254272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651afbf-ab53-4b0c-8960-782ba67e55e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:08.254905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651afbf-ab53-4b0c-8960-782ba67e55e1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:08.255260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651afbf-ab53-4b0c-8960-782ba67e55e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:08.255667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651afbf-ab53-4b0c-8960-782ba67e55e1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:08.256566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651afbf-ab53-4b0c-8960-782ba67e55e1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:08.258009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651afbf-ab53-4b0c-8960-782ba67e55e1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-5651afbf-ab53-4b0c-8960-782ba67e55e1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:08.267717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:08.268816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:08.269698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 296/587] 10.222.0.46 () {56 vars in 1129 bytes} [Mon Oct 24 13:30:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:08.275580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606529d-c16f-4bf1-900b-a9c758749c09 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:08.422225 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:08.445137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606529d-c16f-4bf1-900b-a9c758749c09 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:08.481665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651afbf-ab53-4b0c-8960-782ba67e55e1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:08.504616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227151f7-1155-490d-aed6-269a1fda2c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:08.505520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227151f7-1155-490d-aed6-269a1fda2c3b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:08.505991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227151f7-1155-490d-aed6-269a1fda2c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:08.506533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227151f7-1155-490d-aed6-269a1fda2c3b None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:08.508379 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227151f7-1155-490d-aed6-269a1fda2c3b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:08.508685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227151f7-1155-490d-aed6-269a1fda2c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:08.510083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227151f7-1155-490d-aed6-269a1fda2c3b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:08.521970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 292/588] 10.222.0.46 () {56 vars in 1124 bytes} [Mon Oct 24 13:30:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:08.529073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227151f7-1155-490d-aed6-269a1fda2c3b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:08.665267 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651afbf-ab53-4b0c-8960-782ba67e55e1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:08.712402 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed925e3-800c-48a8-98a2-0539ddb71eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:08.713338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed925e3-800c-48a8-98a2-0539ddb71eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:08.713619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed925e3-800c-48a8-98a2-0539ddb71eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:08.713890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed925e3-800c-48a8-98a2-0539ddb71eb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:08.716653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:08.727648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed925e3-800c-48a8-98a2-0539ddb71eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2ed925e3-800c-48a8-98a2-0539ddb71eb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:08.733706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:08.734634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:08.735494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:08.736117 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227151f7-1155-490d-aed6-269a1fda2c3b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:08.736191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 297/589] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:30:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:08.740919 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed925e3-800c-48a8-98a2-0539ddb71eb5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:08.778717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600beb4-9131-46c1-8263-733909d8396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:08.779456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600beb4-9131-46c1-8263-733909d8396c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:08.779690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600beb4-9131-46c1-8263-733909d8396c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:08.780142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600beb4-9131-46c1-8263-733909d8396c None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:08.780791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600beb4-9131-46c1-8263-733909d8396c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:08.781093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600beb4-9131-46c1-8263-733909d8396c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:08.782676 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600beb4-9131-46c1-8263-733909d8396c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:08.789760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 293/590] 10.222.0.46 () {56 vars in 1124 bytes} [Mon Oct 24 13:30:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:08.796187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bfc1d-4f3a-4465-9d42-b7bb67463fbe None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:08.796334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bfc1d-4f3a-4465-9d42-b7bb67463fbe None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:08.796611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bfc1d-4f3a-4465-9d42-b7bb67463fbe None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:08.802308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 294/591] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:08.802308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bfc1d-4f3a-4465-9d42-b7bb67463fbe None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:08.815976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:08.870113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed925e3-800c-48a8-98a2-0539ddb71eb5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:08.915521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cace9-6514-4e96-b55a-766fb045f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:08.916137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cace9-6514-4e96-b55a-766fb045f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:08.916414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cace9-6514-4e96-b55a-766fb045f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:08.916686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cace9-6514-4e96-b55a-766fb045f4f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:08.917614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cace9-6514-4e96-b55a-766fb045f4f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:08.917915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cace9-6514-4e96-b55a-766fb045f4f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:08.920154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cace9-6514-4e96-b55a-766fb045f4f5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:08.929626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bfc1d-4f3a-4465-9d42-b7bb67463fbe None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:08.931344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 298/592] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:30:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:08.933909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb3b9-be14-4c03-a3e9-a3c4fd2d7991 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:08.934204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb3b9-be14-4c03-a3e9-a3c4fd2d7991 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:08.934481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb3b9-be14-4c03-a3e9-a3c4fd2d7991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:08.957905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1aacb3b9-be14-4c03-a3e9-a3c4fd2d7991 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:08.959853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1aacb3b9-be14-4c03-a3e9-a3c4fd2d7991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:08.975611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d86fec-73b9-4972-a9e5-025c43197c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:08.976239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d86fec-73b9-4972-a9e5-025c43197c21 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:08.976567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d86fec-73b9-4972-a9e5-025c43197c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:08.976884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d86fec-73b9-4972-a9e5-025c43197c21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:08.977698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d86fec-73b9-4972-a9e5-025c43197c21 None admin] RBAC: Adding query filter params (interface=public, service_id=859a8f62bee34e14b575019209e5ea89, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:08.978000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d86fec-73b9-4972-a9e5-025c43197c21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:08.979626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d86fec-73b9-4972-a9e5-025c43197c21 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:08.993754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 295/593] 10.222.0.46 () {56 vars in 1251 bytes} [Mon Oct 24 13:30:08 2022] GET /identity/v3/endpoints?service_id=859a8f62bee34e14b575019209e5ea89&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:08.994543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d86fec-73b9-4972-a9e5-025c43197c21 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:09.017083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:09.042950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 299/594] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:09.044257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb3b9-be14-4c03-a3e9-a3c4fd2d7991 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:09.080454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:09.117358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d86fec-73b9-4972-a9e5-025c43197c21 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:09.199799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a116103-e73c-4248-8af6-97558355e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:09.200719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a116103-e73c-4248-8af6-97558355e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:09.201642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a116103-e73c-4248-8af6-97558355e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:09.201925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a116103-e73c-4248-8af6-97558355e0a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:09.216800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb3b9-be14-4c03-a3e9-a3c4fd2d7991 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:09.225791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a116103-e73c-4248-8af6-97558355e0a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:09.227302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a116103-e73c-4248-8af6-97558355e0a2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-7a116103-e73c-4248-8af6-97558355e0a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:09.255396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:09.256374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:09.257242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:09.257242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:09.257242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:09.259698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 296/595] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:09.265296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a116103-e73c-4248-8af6-97558355e0a2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:09.299656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19053-cdfe-4ef5-a3ff-d431b0861fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:09.300279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19053-cdfe-4ef5-a3ff-d431b0861fde None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:09.300555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19053-cdfe-4ef5-a3ff-d431b0861fde None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:09.300826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19053-cdfe-4ef5-a3ff-d431b0861fde None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:09.301436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d19053-cdfe-4ef5-a3ff-d431b0861fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:09.303141 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d19053-cdfe-4ef5-a3ff-d431b0861fde None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:09.309827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 300/596] 10.222.0.46 () {56 vars in 1087 bytes} [Mon Oct 24 13:30:09 2022] GET /identity/v3/services => generated 772 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:09.371803 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19053-cdfe-4ef5-a3ff-d431b0861fde None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:09.412283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a116103-e73c-4248-8af6-97558355e0a2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:09.428795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:09.443625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:09.454950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030052-6a64-4f14-985b-bf6ac20cd6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:09.455576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030052-6a64-4f14-985b-bf6ac20cd6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:09.455855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030052-6a64-4f14-985b-bf6ac20cd6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:09.456129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030052-6a64-4f14-985b-bf6ac20cd6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:09.456782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a030052-6a64-4f14-985b-bf6ac20cd6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:09.457083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a030052-6a64-4f14-985b-bf6ac20cd6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:09.458510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a030052-6a64-4f14-985b-bf6ac20cd6b0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:09.476010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 297/597] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:09.481513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030052-6a64-4f14-985b-bf6ac20cd6b0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:09.508253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19053-cdfe-4ef5-a3ff-d431b0861fde None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:09.648492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690421-cc97-4da7-a2e8-31936679deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:09.650162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690421-cc97-4da7-a2e8-31936679deb6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:09.650162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690421-cc97-4da7-a2e8-31936679deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:09.650162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690421-cc97-4da7-a2e8-31936679deb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:09.650406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030052-6a64-4f14-985b-bf6ac20cd6b0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:09.679025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09690421-cc97-4da7-a2e8-31936679deb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-09690421-cc97-4da7-a2e8-31936679deb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:09.686834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:09.687809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:09.688634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 301/598] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:30:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:09.697858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690421-cc97-4da7-a2e8-31936679deb6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:09.708149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07cd10-25b8-484c-b001-b9dd919eff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:09.708809 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07cd10-25b8-484c-b001-b9dd919eff54 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:09.709085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07cd10-25b8-484c-b001-b9dd919eff54 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:09.709357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07cd10-25b8-484c-b001-b9dd919eff54 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:09.721719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07cd10-25b8-484c-b001-b9dd919eff54 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:09.723536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07cd10-25b8-484c-b001-b9dd919eff54 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-2e07cd10-25b8-484c-b001-b9dd919eff54 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:09.752297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:09.753240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:09.754184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 298/599] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:30:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:09.760456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07cd10-25b8-484c-b001-b9dd919eff54 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:09.815379 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:09.902175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07cd10-25b8-484c-b001-b9dd919eff54 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:09.930948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690421-cc97-4da7-a2e8-31936679deb6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:09.953849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:09.969209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3cb29-eb0b-4f50-a9fd-45eea2bc00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:09.969866 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3cb29-eb0b-4f50-a9fd-45eea2bc00b0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:09.970088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3cb29-eb0b-4f50-a9fd-45eea2bc00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:09.970421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3cb29-eb0b-4f50-a9fd-45eea2bc00b0 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:09.971230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3cb29-eb0b-4f50-a9fd-45eea2bc00b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:09.971528 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3cb29-eb0b-4f50-a9fd-45eea2bc00b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:09.973417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3cb29-eb0b-4f50-a9fd-45eea2bc00b0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:09.993659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 299/600] 10.222.0.46 () {56 vars in 1135 bytes} [Mon Oct 24 13:30:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:10.000039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3cb29-eb0b-4f50-a9fd-45eea2bc00b0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:10.007103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314f95-e3b4-4a44-841f-f92ae8b482d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:10.007722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314f95-e3b4-4a44-841f-f92ae8b482d6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.007993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314f95-e3b4-4a44-841f-f92ae8b482d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.008266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314f95-e3b4-4a44-841f-f92ae8b482d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.008924 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42314f95-e3b4-4a44-841f-f92ae8b482d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:10.009219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42314f95-e3b4-4a44-841f-f92ae8b482d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:10.011193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42314f95-e3b4-4a44-841f-f92ae8b482d6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:10.035130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 302/601] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:30:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:10.041133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314f95-e3b4-4a44-841f-f92ae8b482d6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:10.192264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3cb29-eb0b-4f50-a9fd-45eea2bc00b0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:10.195909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:10.264567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfa356-4ba8-49ef-b9e8-a2091f57523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:10.265363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfa356-4ba8-49ef-b9e8-a2091f57523f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.265823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfa356-4ba8-49ef-b9e8-a2091f57523f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.266101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfa356-4ba8-49ef-b9e8-a2091f57523f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.363035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314f95-e3b4-4a44-841f-f92ae8b482d6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:10.414449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfa356-4ba8-49ef-b9e8-a2091f57523f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:10.421564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfa356-4ba8-49ef-b9e8-a2091f57523f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:10.442488 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673f6d2-0984-4a0b-82d3-0b46a7c4b9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:10.443353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f6d2-0984-4a0b-82d3-0b46a7c4b9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.443710 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f6d2-0984-4a0b-82d3-0b46a7c4b9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.443989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f6d2-0984-4a0b-82d3-0b46a7c4b9b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.468123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673f6d2-0984-4a0b-82d3-0b46a7c4b9b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:10.469652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673f6d2-0984-4a0b-82d3-0b46a7c4b9b5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0673f6d2-0984-4a0b-82d3-0b46a7c4b9b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:10.504998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:10.506036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:10.506952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:10.506952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:10.506952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:10.508927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 303/602] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:10.510127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e7cc-5f32-4007-ba5d-aad14cc920cd None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.512816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e7cc-5f32-4007-ba5d-aad14cc920cd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.513056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e7cc-5f32-4007-ba5d-aad14cc920cd None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.516780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 304/603] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:10.517449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e7cc-5f32-4007-ba5d-aad14cc920cd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:10.561465 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:10.582802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 300/604] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:30:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:30:10.584399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd27d-52b6-4f57-872c-e9042b2a6819 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.584636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd27d-52b6-4f57-872c-e9042b2a6819 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.584903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd27d-52b6-4f57-872c-e9042b2a6819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.593495 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:10.606912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-59cfd27d-52b6-4f57-872c-e9042b2a6819 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:10.608115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-59cfd27d-52b6-4f57-872c-e9042b2a6819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:10.669239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e7cc-5f32-4007-ba5d-aad14cc920cd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:10.683022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 301/605] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:10.688102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfd27d-52b6-4f57-872c-e9042b2a6819 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:10.713071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5592be-1cd5-43dc-b73d-87f8efabf5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:10.714405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5592be-1cd5-43dc-b73d-87f8efabf5ad None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.714861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5592be-1cd5-43dc-b73d-87f8efabf5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.715327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5592be-1cd5-43dc-b73d-87f8efabf5ad None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.716144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5592be-1cd5-43dc-b73d-87f8efabf5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:10.716616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5592be-1cd5-43dc-b73d-87f8efabf5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:10.719138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5592be-1cd5-43dc-b73d-87f8efabf5ad None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:10.736527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 305/606] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:10.738206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b6c92-1917-4a15-9429-d0046b57c09f None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.738731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b6c92-1917-4a15-9429-d0046b57c09f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.739932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b6c92-1917-4a15-9429-d0046b57c09f None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.742499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 306/607] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:10.743612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b6c92-1917-4a15-9429-d0046b57c09f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:10.827070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfd27d-52b6-4f57-872c-e9042b2a6819 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:10.839492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:10.871993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b6c92-1917-4a15-9429-d0046b57c09f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:10.877029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d120e49-eab8-415c-aec1-6a0e1072663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:10.877973 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120e49-eab8-415c-aec1-6a0e1072663f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.878449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120e49-eab8-415c-aec1-6a0e1072663f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.878909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120e49-eab8-415c-aec1-6a0e1072663f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.881583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:10.891839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d120e49-eab8-415c-aec1-6a0e1072663f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:10.893840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d120e49-eab8-415c-aec1-6a0e1072663f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-2d120e49-eab8-415c-aec1-6a0e1072663f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:10.910657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:10.912009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:10.913027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:10.913027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:10.913027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:10.914451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4d75-2101-4293-8ef5-b59a1ef25454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:10.915172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4d75-2101-4293-8ef5-b59a1ef25454 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.915398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4d75-2101-4293-8ef5-b59a1ef25454 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.915790 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4d75-2101-4293-8ef5-b59a1ef25454 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.916080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 302/608] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:10.917484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06c6c3-f218-49cc-8ccf-cf4382214e74 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:10.917962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06c6c3-f218-49cc-8ccf-cf4382214e74 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:10.918438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06c6c3-f218-49cc-8ccf-cf4382214e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:10.923544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd4d75-2101-4293-8ef5-b59a1ef25454 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:10.925158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd4d75-2101-4293-8ef5-b59a1ef25454 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:10.938570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-be06c6c3-f218-49cc-8ccf-cf4382214e74 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a2dd4d75-2101-4293-8ef5-b59a1ef25454 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:10.939852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:10.941229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 307/609] 10.222.0.46 () {56 vars in 1117 bytes} [Mon Oct 24 13:30:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:10.942950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4d75-2101-4293-8ef5-b59a1ef25454 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:10.944243 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-be06c6c3-f218-49cc-8ccf-cf4382214e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:11.019717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 303/610] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:11.020376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06c6c3-f218-49cc-8ccf-cf4382214e74 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.097131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4d75-2101-4293-8ef5-b59a1ef25454 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:11.142949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18175b2-3d59-4975-94eb-289ff56eccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:11.142949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18175b2-3d59-4975-94eb-289ff56eccee None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:11.142949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18175b2-3d59-4975-94eb-289ff56eccee None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:11.142949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18175b2-3d59-4975-94eb-289ff56eccee None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:11.143382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18175b2-3d59-4975-94eb-289ff56eccee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:11.143382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18175b2-3d59-4975-94eb-289ff56eccee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:11.146944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18175b2-3d59-4975-94eb-289ff56eccee None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:11.151096 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06c6c3-f218-49cc-8ccf-cf4382214e74 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:11.163074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 308/611] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:11.164246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18175b2-3d59-4975-94eb-289ff56eccee None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.169867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:11.173271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:11.201392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fd833-915d-4d53-bb78-180443460049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:11.202485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fd833-915d-4d53-bb78-180443460049 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:11.203112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fd833-915d-4d53-bb78-180443460049 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:11.203589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fd833-915d-4d53-bb78-180443460049 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:11.204561 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fd833-915d-4d53-bb78-180443460049 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:11.205311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fd833-915d-4d53-bb78-180443460049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:11.207667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fd833-915d-4d53-bb78-180443460049 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:11.231802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 304/612] 10.222.0.46 () {56 vars in 1149 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:11.231802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fd833-915d-4d53-bb78-180443460049 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.295669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18175b2-3d59-4975-94eb-289ff56eccee None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:11.341405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2eb8c-736b-4f4a-83c4-1ce51a105be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:11.342607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2eb8c-736b-4f4a-83c4-1ce51a105be9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:11.343330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2eb8c-736b-4f4a-83c4-1ce51a105be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:11.343749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2eb8c-736b-4f4a-83c4-1ce51a105be9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:11.344967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2eb8c-736b-4f4a-83c4-1ce51a105be9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:11.347396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2eb8c-736b-4f4a-83c4-1ce51a105be9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:11.352899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fd833-915d-4d53-bb78-180443460049 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-65d2eb8c-736b-4f4a-83c4-1ce51a105be9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:11.358541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:11.359558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:30:11.360446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:11.361173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 309/613] 10.222.0.46 () {56 vars in 1132 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:11.361987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2eb8c-736b-4f4a-83c4-1ce51a105be9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.390715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3789e4-85fe-419b-97c1-0eeb9ba86cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:11.391406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3789e4-85fe-419b-97c1-0eeb9ba86cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:11.391673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3789e4-85fe-419b-97c1-0eeb9ba86cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:11.392016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3789e4-85fe-419b-97c1-0eeb9ba86cf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:11.400393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3789e4-85fe-419b-97c1-0eeb9ba86cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:11.402228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3789e4-85fe-419b-97c1-0eeb9ba86cf4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-6b3789e4-85fe-419b-97c1-0eeb9ba86cf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:11.414823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:11.415887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:11.416781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:11.416781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:11.416781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:11.416781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:11.416781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:11.416781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:11.416781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:11.416781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:11.420839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 305/614] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:11.421770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3789e4-85fe-419b-97c1-0eeb9ba86cf4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.452587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:11.458236 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:11.496116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2eb8c-736b-4f4a-83c4-1ce51a105be9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:11.530385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3789e4-85fe-419b-97c1-0eeb9ba86cf4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:11.531813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778af7-7477-4667-a385-f67af6537ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:11.532625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778af7-7477-4667-a385-f67af6537ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:11.533707 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778af7-7477-4667-a385-f67af6537ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:11.533978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778af7-7477-4667-a385-f67af6537ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:11.567692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228d0c-98fe-40b4-97dd-c225059be08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:11.568413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228d0c-98fe-40b4-97dd-c225059be08b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:11.568687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228d0c-98fe-40b4-97dd-c225059be08b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:11.568950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228d0c-98fe-40b4-97dd-c225059be08b None admin] PATH_INFO: `/v3/services/network` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:11.569560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4228d0c-98fe-40b4-97dd-c225059be08b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:11.570941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4228d0c-98fe-40b4-97dd-c225059be08b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d4228d0c-98fe-40b4-97dd-c225059be08b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:11.579881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:11.580928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:11.581778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 306/615] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:11.582556 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228d0c-98fe-40b4-97dd-c225059be08b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.613390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58778af7-7477-4667-a385-f67af6537ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:11.615956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58778af7-7477-4667-a385-f67af6537ac5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:11.687518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:11.691524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:11.691650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228d0c-98fe-40b4-97dd-c225059be08b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:11.732876 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ead0d-dfcf-4139-a65d-25025b21dfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:11.733484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ead0d-dfcf-4139-a65d-25025b21dfec None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:11.733747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ead0d-dfcf-4139-a65d-25025b21dfec None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:11.733958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 310/616] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:30:11.734059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ead0d-dfcf-4139-a65d-25025b21dfec None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:11.734706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ead0d-dfcf-4139-a65d-25025b21dfec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:11.735028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ead0d-dfcf-4139-a65d-25025b21dfec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:11.735518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778af7-7477-4667-a385-f67af6537ac5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.736400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ead0d-dfcf-4139-a65d-25025b21dfec None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:11.742322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 307/617] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:11.743218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ead0d-dfcf-4139-a65d-25025b21dfec None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.846479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778af7-7477-4667-a385-f67af6537ac5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:11.861939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ead0d-dfcf-4139-a65d-25025b21dfec None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:11.888138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16304048-ad67-48a5-9bf6-84cc0b4fadc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:11.889052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304048-ad67-48a5-9bf6-84cc0b4fadc5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:11.889335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304048-ad67-48a5-9bf6-84cc0b4fadc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:11.889861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304048-ad67-48a5-9bf6-84cc0b4fadc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:11.890552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16304048-ad67-48a5-9bf6-84cc0b4fadc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:11.891110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16304048-ad67-48a5-9bf6-84cc0b4fadc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:11.893292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16304048-ad67-48a5-9bf6-84cc0b4fadc5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:11.896477 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331a4eb-de77-4e9f-a5cf-764156df989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:11.897089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331a4eb-de77-4e9f-a5cf-764156df989e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:11.897367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331a4eb-de77-4e9f-a5cf-764156df989e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:11.897636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331a4eb-de77-4e9f-a5cf-764156df989e None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:11.898268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331a4eb-de77-4e9f-a5cf-764156df989e None admin] RBAC: Adding query filter params (name=network) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:11.898568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331a4eb-de77-4e9f-a5cf-764156df989e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:11.900016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331a4eb-de77-4e9f-a5cf-764156df989e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:11.911805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 308/618] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:11.911805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331a4eb-de77-4e9f-a5cf-764156df989e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.912075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 311/619] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:11.912075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16304048-ad67-48a5-9bf6-84cc0b4fadc5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:11.943272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:11.947531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:12.016064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16304048-ad67-48a5-9bf6-84cc0b4fadc5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:12.018097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331a4eb-de77-4e9f-a5cf-764156df989e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:12.052109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136b877-b99b-4cc4-b69d-af205ca3ee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:12.052427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4f16f-56fa-47d1-91a0-97fe7af994a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:12.052901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b877-b99b-4cc4-b69d-af205ca3ee27 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.052996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b877-b99b-4cc4-b69d-af205ca3ee27 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:12.053090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4f16f-56fa-47d1-91a0-97fe7af994a4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.053216 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b877-b99b-4cc4-b69d-af205ca3ee27 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:12.053318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4f16f-56fa-47d1-91a0-97fe7af994a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:12.053577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4f16f-56fa-47d1-91a0-97fe7af994a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:12.053827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b877-b99b-4cc4-b69d-af205ca3ee27 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:12.054121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b877-b99b-4cc4-b69d-af205ca3ee27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:12.055521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b877-b99b-4cc4-b69d-af205ca3ee27 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:12.059866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 312/620] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:12.060640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136b877-b99b-4cc4-b69d-af205ca3ee27 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:12.070548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4f16f-56fa-47d1-91a0-97fe7af994a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:12.072081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4f16f-56fa-47d1-91a0-97fe7af994a4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-aba4f16f-56fa-47d1-91a0-97fe7af994a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:12.089909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:12.090984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:12.091894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:12.091894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:12.091894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:12.097962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 309/621] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:12.097962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4f16f-56fa-47d1-91a0-97fe7af994a4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:12.168385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:12.178029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136b877-b99b-4cc4-b69d-af205ca3ee27 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:12.199024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:12.215713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7463291-7c1c-433a-8d8d-782a3977311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:12.216326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7463291-7c1c-433a-8d8d-782a3977311f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.216598 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7463291-7c1c-433a-8d8d-782a3977311f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:12.216862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7463291-7c1c-433a-8d8d-782a3977311f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:12.217595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7463291-7c1c-433a-8d8d-782a3977311f None admin] RBAC: Adding query filter params (role.id=581091dd624142d3aad6710d1eb0affa, scope.project.id=11342796e85b428195cf5155b512162c, user.id=28110c7825734d229ac61878eacbe49e) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:12.217893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7463291-7c1c-433a-8d8d-782a3977311f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:12.219410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7463291-7c1c-433a-8d8d-782a3977311f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:12.228213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4f16f-56fa-47d1-91a0-97fe7af994a4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:12.235176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 313/622] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:30:12 2022] GET /identity/v3/role_assignments?user.id=28110c7825734d229ac61878eacbe49e&scope.project.id=11342796e85b428195cf5155b512162c&role.id=581091dd624142d3aad6710d1eb0affa => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:12.237856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013834c-6094-4cab-b87e-96292b702fe5 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.238457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013834c-6094-4cab-b87e-96292b702fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:12.238944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013834c-6094-4cab-b87e-96292b702fe5 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:12.241399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 314/623] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:12.243241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013834c-6094-4cab-b87e-96292b702fe5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:12.282421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31d87c-4959-484a-85db-64ccd520d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:12.285371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31d87c-4959-484a-85db-64ccd520d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.285371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31d87c-4959-484a-85db-64ccd520d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:12.285371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31d87c-4959-484a-85db-64ccd520d2f7 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:12.285371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31d87c-4959-484a-85db-64ccd520d2f7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:12.285371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31d87c-4959-484a-85db-64ccd520d2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:12.287589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31d87c-4959-484a-85db-64ccd520d2f7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:12.294517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 310/624] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:12.295669 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa377cf5-8446-4b10-93ac-e4d3e789dd08 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.295945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa377cf5-8446-4b10-93ac-e4d3e789dd08 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:12.296215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa377cf5-8446-4b10-93ac-e4d3e789dd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:12.323583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fa377cf5-8446-4b10-93ac-e4d3e789dd08 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:12.324812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fa377cf5-8446-4b10-93ac-e4d3e789dd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:12.418497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013834c-6094-4cab-b87e-96292b702fe5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:12.421017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 311/625] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:12.421355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa377cf5-8446-4b10-93ac-e4d3e789dd08 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:12.460737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad92b-28a6-490b-b224-4cf871f356aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:12.461779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad92b-28a6-490b-b224-4cf871f356aa None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.462241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad92b-28a6-490b-b224-4cf871f356aa None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:12.462722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad92b-28a6-490b-b224-4cf871f356aa None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:12.463571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ad92b-28a6-490b-b224-4cf871f356aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:12.464073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ad92b-28a6-490b-b224-4cf871f356aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:12.465709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ad92b-28a6-490b-b224-4cf871f356aa None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:12.481403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 315/626] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:12.491897 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad92b-28a6-490b-b224-4cf871f356aa None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:12.501240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:12.523720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:12.534864 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa377cf5-8446-4b10-93ac-e4d3e789dd08 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:12.577683 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b46ce7-322d-40e9-8fdf-b0bef5932d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:12.578669 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b46ce7-322d-40e9-8fdf-b0bef5932d1a None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.579199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b46ce7-322d-40e9-8fdf-b0bef5932d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:12.579658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b46ce7-322d-40e9-8fdf-b0bef5932d1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:12.580635 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b46ce7-322d-40e9-8fdf-b0bef5932d1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:12.582218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b46ce7-322d-40e9-8fdf-b0bef5932d1a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:12.624540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 312/627] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:30:12 2022] POST /identity/v3/endpoints => generated 337 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:12.646630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad92b-28a6-490b-b224-4cf871f356aa None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:12.722525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d6775-b8de-4c7a-bd2b-0b8095b5c4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:12.723125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d6775-b8de-4c7a-bd2b-0b8095b5c4ef None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.723397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d6775-b8de-4c7a-bd2b-0b8095b5c4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:12.723782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d6775-b8de-4c7a-bd2b-0b8095b5c4ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:12.748038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d6775-b8de-4c7a-bd2b-0b8095b5c4ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:12.749564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d6775-b8de-4c7a-bd2b-0b8095b5c4ef None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a62d6775-b8de-4c7a-bd2b-0b8095b5c4ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:12.771661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:12.772651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:12.773521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:12.773521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:12.773521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:12.773521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:12.773521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:12.773521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:12.773521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:12.773521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:12.773521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 316/628] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:12.779239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b46ce7-322d-40e9-8fdf-b0bef5932d1a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:12.799946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d6775-b8de-4c7a-bd2b-0b8095b5c4ef None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:12.903257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:12.953018 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b46ce7-322d-40e9-8fdf-b0bef5932d1a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:12.965923 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d6775-b8de-4c7a-bd2b-0b8095b5c4ef None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:12.989720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:12.999068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6a5e4-2eb8-46e7-b7cb-2d8279b168c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:12.999706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6a5e4-2eb8-46e7-b7cb-2d8279b168c3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:12.999984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6a5e4-2eb8-46e7-b7cb-2d8279b168c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:13.000252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6a5e4-2eb8-46e7-b7cb-2d8279b168c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:13.001034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6a5e4-2eb8-46e7-b7cb-2d8279b168c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:13.001341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6a5e4-2eb8-46e7-b7cb-2d8279b168c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:13.004930 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6a5e4-2eb8-46e7-b7cb-2d8279b168c3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:13.013165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88d329-e8b5-4d15-8754-7aaef940b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:13.014098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d329-e8b5-4d15-8754-7aaef940b3ce None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:13.014561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d329-e8b5-4d15-8754-7aaef940b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:13.015090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d329-e8b5-4d15-8754-7aaef940b3ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:13.015870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88d329-e8b5-4d15-8754-7aaef940b3ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:13.017526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88d329-e8b5-4d15-8754-7aaef940b3ce None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:13.019025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 313/629] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:30:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:13.029024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6a5e4-2eb8-46e7-b7cb-2d8279b168c3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2c88d329-e8b5-4d15-8754-7aaef940b3ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:13.029294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:13.030228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:13.040017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 317/630] 10.222.0.46 () {56 vars in 1129 bytes} [Mon Oct 24 13:30:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:13.040801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88d329-e8b5-4d15-8754-7aaef940b3ce None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:13.166961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6a5e4-2eb8-46e7-b7cb-2d8279b168c3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:13.190094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88d329-e8b5-4d15-8754-7aaef940b3ce None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:13.202650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db462de-b0b6-4ced-90d7-0dd9f377f695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:13.203499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db462de-b0b6-4ced-90d7-0dd9f377f695 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:13.203832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db462de-b0b6-4ced-90d7-0dd9f377f695 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:13.204155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db462de-b0b6-4ced-90d7-0dd9f377f695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:13.205033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db462de-b0b6-4ced-90d7-0dd9f377f695 None admin] RBAC: Adding query filter params (role.id=69a1febe83c9483cb6175c815d7e4f8e, scope.project.id=11342796e85b428195cf5155b512162c, user.id=4c7f48b7688f4bbbb318f0ea8178d5d4) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:13.205395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db462de-b0b6-4ced-90d7-0dd9f377f695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:13.206881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db462de-b0b6-4ced-90d7-0dd9f377f695 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:13.213846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 314/631] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:30:13 2022] GET /identity/v3/role_assignments?user.id=4c7f48b7688f4bbbb318f0ea8178d5d4&scope.project.id=11342796e85b428195cf5155b512162c&role.id=69a1febe83c9483cb6175c815d7e4f8e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:13.232060 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f56e62-5c08-4023-8836-b3aaa52624ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:13.232699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f56e62-5c08-4023-8836-b3aaa52624ef None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:13.233041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f56e62-5c08-4023-8836-b3aaa52624ef None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:13.233314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f56e62-5c08-4023-8836-b3aaa52624ef None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:13.233974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f56e62-5c08-4023-8836-b3aaa52624ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:13.234330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f56e62-5c08-4023-8836-b3aaa52624ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:13.235824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f56e62-5c08-4023-8836-b3aaa52624ef None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:13.238154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:13.242143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 318/632] 10.222.0.46 () {56 vars in 1124 bytes} [Mon Oct 24 13:30:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:13.247703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db462de-b0b6-4ced-90d7-0dd9f377f695 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:13.331286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:13.395817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db462de-b0b6-4ced-90d7-0dd9f377f695 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:13.432232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077836-6e43-4764-acd3-2b3c375992b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:13.432858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077836-6e43-4764-acd3-2b3c375992b9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:13.433128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077836-6e43-4764-acd3-2b3c375992b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:13.433393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077836-6e43-4764-acd3-2b3c375992b9 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:13.434024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f077836-6e43-4764-acd3-2b3c375992b9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:13.434316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f077836-6e43-4764-acd3-2b3c375992b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:13.435785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f077836-6e43-4764-acd3-2b3c375992b9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:13.442424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 315/633] 10.222.0.46 () {56 vars in 1124 bytes} [Mon Oct 24 13:30:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:13.448815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f56e62-5c08-4023-8836-b3aaa52624ef None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:13.557307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f56e62-5c08-4023-8836-b3aaa52624ef None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:13.593741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68c76-5f77-41ef-bcd6-b92d44ba841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:13.594729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68c76-5f77-41ef-bcd6-b92d44ba841c None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:13.595235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68c76-5f77-41ef-bcd6-b92d44ba841c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:13.595709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68c76-5f77-41ef-bcd6-b92d44ba841c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:13.596622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68c76-5f77-41ef-bcd6-b92d44ba841c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:13.598201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68c76-5f77-41ef-bcd6-b92d44ba841c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:13.633087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 319/634] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:30:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:14.415492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaa94b-97d1-48a8-b4b3-523b5ec5c1e8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:14.416481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaa94b-97d1-48a8-b4b3-523b5ec5c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:14.416954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaa94b-97d1-48a8-b4b3-523b5ec5c1e8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:14.418801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 316/635] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:14.423977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b70f-682d-4b48-8b09-89f49619398f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:14.424416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b70f-682d-4b48-8b09-89f49619398f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:14.424523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b70f-682d-4b48-8b09-89f49619398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:14.443387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3fd4b70f-682d-4b48-8b09-89f49619398f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:14.444570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3fd4b70f-682d-4b48-8b09-89f49619398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:14.502043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:14.531043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 320/636] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:14.716302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed97904-2d39-4a3f-8f24-98c1ebfc0e42 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:14.716494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed97904-2d39-4a3f-8f24-98c1ebfc0e42 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:14.716762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed97904-2d39-4a3f-8f24-98c1ebfc0e42 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:14.718238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 317/637] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:14.724802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b44ce-0df6-4e9e-aa12-92ec9cf1e0ba None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:14.724802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b44ce-0df6-4e9e-aa12-92ec9cf1e0ba None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:14.724802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b44ce-0df6-4e9e-aa12-92ec9cf1e0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:14.750691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-dd3b44ce-0df6-4e9e-aa12-92ec9cf1e0ba None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:14.753451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-dd3b44ce-0df6-4e9e-aa12-92ec9cf1e0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:14.810063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed97904-2d39-4a3f-8f24-98c1ebfc0e42 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:14.931326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 321/638] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:14.973435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed97904-2d39-4a3f-8f24-98c1ebfc0e42 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:14.991941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:15.012360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6ca6-a40f-4527-9503-cf0ba5010c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:15.013334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6ca6-a40f-4527-9503-cf0ba5010c7e None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:15.013820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6ca6-a40f-4527-9503-cf0ba5010c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:15.014296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6ca6-a40f-4527-9503-cf0ba5010c7e None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:15.015162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b6ca6-a40f-4527-9503-cf0ba5010c7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:15.016925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b6ca6-a40f-4527-9503-cf0ba5010c7e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:15.036462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 318/639] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:30:14 2022] POST /identity/v3/services => generated 269 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:15.240175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b44ce-0df6-4e9e-aa12-92ec9cf1e0ba None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:15.354952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b44ce-0df6-4e9e-aa12-92ec9cf1e0ba None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:15.369953 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:15.402951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc4d85-478d-43ea-a3f6-7e74611262be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:15.402951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc4d85-478d-43ea-a3f6-7e74611262be None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:15.402951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc4d85-478d-43ea-a3f6-7e74611262be None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:15.402951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc4d85-478d-43ea-a3f6-7e74611262be None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:15.403376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc4d85-478d-43ea-a3f6-7e74611262be None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:15.406945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc4d85-478d-43ea-a3f6-7e74611262be None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-eacc4d85-478d-43ea-a3f6-7e74611262be None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:15.417223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:15.418281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:15.419160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:15.422951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 322/640] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:15.426984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6ca6-a40f-4527-9503-cf0ba5010c7e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:15.546949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6ca6-a40f-4527-9503-cf0ba5010c7e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:15.565751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f33cd-93c5-4fb9-be48-9671e92b4c11 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:15.566280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f33cd-93c5-4fb9-be48-9671e92b4c11 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:15.566280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f33cd-93c5-4fb9-be48-9671e92b4c11 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:15.576118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 323/641] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:15.580610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eedf47-0d80-4215-95f1-b554246f3441 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:15.581103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eedf47-0d80-4215-95f1-b554246f3441 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:15.581590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eedf47-0d80-4215-95f1-b554246f3441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:15.584853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af388c8c-06e7-4695-a3c0-1419fba8111b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:15.585472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af388c8c-06e7-4695-a3c0-1419fba8111b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:15.585748 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af388c8c-06e7-4695-a3c0-1419fba8111b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:15.586025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af388c8c-06e7-4695-a3c0-1419fba8111b None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:15.586710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af388c8c-06e7-4695-a3c0-1419fba8111b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:15.587086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af388c8c-06e7-4695-a3c0-1419fba8111b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:15.588492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af388c8c-06e7-4695-a3c0-1419fba8111b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:15.600738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 319/642] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:15.601210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af388c8c-06e7-4695-a3c0-1419fba8111b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:15.608038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-64eedf47-0d80-4215-95f1-b554246f3441 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:15.609526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-64eedf47-0d80-4215-95f1-b554246f3441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:15.674485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:15.751210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 324/643] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:15 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:15.806415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af388c8c-06e7-4695-a3c0-1419fba8111b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:15.891644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b323f15-f94d-490f-88b6-156e1bd26e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:15.892661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b323f15-f94d-490f-88b6-156e1bd26e2e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:15.893139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b323f15-f94d-490f-88b6-156e1bd26e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:15.893627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b323f15-f94d-490f-88b6-156e1bd26e2e None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:15.894481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b323f15-f94d-490f-88b6-156e1bd26e2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:15.895105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b323f15-f94d-490f-88b6-156e1bd26e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:15.896811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b323f15-f94d-490f-88b6-156e1bd26e2e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:15.911473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 320/644] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:16.096139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eedf47-0d80-4215-95f1-b554246f3441 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:16.149703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1290c-252b-44b0-976a-8b2af68d7c81 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:16.150818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1290c-252b-44b0-976a-8b2af68d7c81 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:16.151318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1290c-252b-44b0-976a-8b2af68d7c81 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:16.153121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 321/645] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:30:16.164830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ad7c7-4bc8-45d6-92f9-c6448d1d7c94 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:16.165430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ad7c7-4bc8-45d6-92f9-c6448d1d7c94 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:16.165908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ad7c7-4bc8-45d6-92f9-c6448d1d7c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:16.198559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d30ad7c7-4bc8-45d6-92f9-c6448d1d7c94 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:16.201377 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d30ad7c7-4bc8-45d6-92f9-c6448d1d7c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:16.234632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eedf47-0d80-4215-95f1-b554246f3441 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:16.236382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:16.277765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c5030-2f2a-4f91-a426-ab0a301fce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:16.278418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c5030-2f2a-4f91-a426-ab0a301fce26 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:16.278694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c5030-2f2a-4f91-a426-ab0a301fce26 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:16.278987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c5030-2f2a-4f91-a426-ab0a301fce26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:16.294093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c5030-2f2a-4f91-a426-ab0a301fce26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:16.298024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 322/646] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:16 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-e15c5030-2f2a-4f91-a426-ab0a301fce26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:16.299377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:16.300335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:16.301174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 325/647] 10.222.0.46 () {56 vars in 1120 bytes} [Mon Oct 24 13:30:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:16.310985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ad7c7-4bc8-45d6-92f9-c6448d1d7c94 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:16.343311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:16.415157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ad7c7-4bc8-45d6-92f9-c6448d1d7c94 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:16.455416 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bbf07-1a13-4d4d-ba48-93670f016638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:16.456836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bbf07-1a13-4d4d-ba48-93670f016638 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:16.457367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bbf07-1a13-4d4d-ba48-93670f016638 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:16.457881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bbf07-1a13-4d4d-ba48-93670f016638 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:16.458783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bbf07-1a13-4d4d-ba48-93670f016638 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:16.459321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bbf07-1a13-4d4d-ba48-93670f016638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:16.460890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bbf07-1a13-4d4d-ba48-93670f016638 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:16.470634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 323/648] 10.222.0.46 () {56 vars in 1115 bytes} [Mon Oct 24 13:30:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:16.477115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c5030-2f2a-4f91-a426-ab0a301fce26 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:16.566579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bbf07-1a13-4d4d-ba48-93670f016638 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:16.598444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c5030-2f2a-4f91-a426-ab0a301fce26 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:16.641169 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493cd8b-268b-4784-a69f-feb812dd075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:16.642685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493cd8b-268b-4784-a69f-feb812dd075e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:16.643623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493cd8b-268b-4784-a69f-feb812dd075e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:16.644095 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493cd8b-268b-4784-a69f-feb812dd075e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:16.657857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493cd8b-268b-4784-a69f-feb812dd075e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:16.660458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493cd8b-268b-4784-a69f-feb812dd075e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-5493cd8b-268b-4784-a69f-feb812dd075e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:16.683107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:16.684139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:16.685033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:16.685033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:16.685033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:16.691437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:16.691905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 326/649] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:16.693135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493cd8b-268b-4784-a69f-feb812dd075e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:16.695850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bbf07-1a13-4d4d-ba48-93670f016638 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:16.717666 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:16.740359 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8026a-2ddb-4a76-a111-3b4467c08c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:16.741010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8026a-2ddb-4a76-a111-3b4467c08c55 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:16.741297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8026a-2ddb-4a76-a111-3b4467c08c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:16.742396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8026a-2ddb-4a76-a111-3b4467c08c55 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:16.743037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8026a-2ddb-4a76-a111-3b4467c08c55 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:16.744425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8026a-2ddb-4a76-a111-3b4467c08c55 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-83b8026a-2ddb-4a76-a111-3b4467c08c55 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:16.755859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:16.756931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:16.757766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 324/650] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:30:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:16.762685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8026a-2ddb-4a76-a111-3b4467c08c55 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:16.826950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493cd8b-268b-4784-a69f-feb812dd075e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:16.866744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b737-06d1-4d01-9403-560bf16e9ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:16.867761 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b737-06d1-4d01-9403-560bf16e9ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:16.868222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b737-06d1-4d01-9403-560bf16e9ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:16.868704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b737-06d1-4d01-9403-560bf16e9ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:16.869648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0b737-06d1-4d01-9403-560bf16e9ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:16.870122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0b737-06d1-4d01-9403-560bf16e9ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:16.871937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0b737-06d1-4d01-9403-560bf16e9ba3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:16.878106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8026a-2ddb-4a76-a111-3b4467c08c55 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:16.885663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 327/651] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:16.895174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b737-06d1-4d01-9403-560bf16e9ba3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:16.926125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121c34-4e16-4466-9bce-1d23a58ff34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:16.927087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121c34-4e16-4466-9bce-1d23a58ff34c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:16.927607 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121c34-4e16-4466-9bce-1d23a58ff34c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:16.927950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121c34-4e16-4466-9bce-1d23a58ff34c None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:16.928679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15121c34-4e16-4466-9bce-1d23a58ff34c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:16.929050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15121c34-4e16-4466-9bce-1d23a58ff34c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:16.930734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15121c34-4e16-4466-9bce-1d23a58ff34c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:16.941098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 325/652] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:30:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:16.942184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121c34-4e16-4466-9bce-1d23a58ff34c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:16.968780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:17.015732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:17.049661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b737-06d1-4d01-9403-560bf16e9ba3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:17.065603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121c34-4e16-4466-9bce-1d23a58ff34c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:17.086967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262b1e2-10d0-4c35-9994-2a9de06f5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:17.087713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262b1e2-10d0-4c35-9994-2a9de06f5b26 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:17.088055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262b1e2-10d0-4c35-9994-2a9de06f5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:17.088475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262b1e2-10d0-4c35-9994-2a9de06f5b26 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:17.096289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262b1e2-10d0-4c35-9994-2a9de06f5b26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:17.097921 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262b1e2-10d0-4c35-9994-2a9de06f5b26 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:17.109553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76434e-eef0-4dae-a334-3a58e6f7f354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:17.110469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76434e-eef0-4dae-a334-3a58e6f7f354 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:17.110939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76434e-eef0-4dae-a334-3a58e6f7f354 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-e262b1e2-10d0-4c35-9994-2a9de06f5b26 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:17.111327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:17.112237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:30:17.113268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:17.114423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76434e-eef0-4dae-a334-3a58e6f7f354 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:17.115259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76434e-eef0-4dae-a334-3a58e6f7f354 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:17.115718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76434e-eef0-4dae-a334-3a58e6f7f354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:17.117489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76434e-eef0-4dae-a334-3a58e6f7f354 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:17.117801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 328/653] 10.222.0.46 () {56 vars in 1117 bytes} [Mon Oct 24 13:30:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:17.118701 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262b1e2-10d0-4c35-9994-2a9de06f5b26 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:17.124141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 326/654] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:30:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:17.236795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262b1e2-10d0-4c35-9994-2a9de06f5b26 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:17.276103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7121472-5a98-4ffd-8206-5760bde20f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:17.277076 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7121472-5a98-4ffd-8206-5760bde20f74 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:17.277546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7121472-5a98-4ffd-8206-5760bde20f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:17.278008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7121472-5a98-4ffd-8206-5760bde20f74 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:17.278978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7121472-5a98-4ffd-8206-5760bde20f74 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:17.279505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7121472-5a98-4ffd-8206-5760bde20f74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:17.281192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7121472-5a98-4ffd-8206-5760bde20f74 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:17.283407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:17.304073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 329/655] 10.222.0.46 () {56 vars in 1149 bytes} [Mon Oct 24 13:30:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:17.309750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76434e-eef0-4dae-a334-3a58e6f7f354 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:17.425461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:17.440529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76434e-eef0-4dae-a334-3a58e6f7f354 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:17.478486 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586876-7b4a-47ec-8631-03ce6d935a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:17.480011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586876-7b4a-47ec-8631-03ce6d935a37 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:17.480415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586876-7b4a-47ec-8631-03ce6d935a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:17.481081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586876-7b4a-47ec-8631-03ce6d935a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:17.492757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76586876-7b4a-47ec-8631-03ce6d935a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:17.494459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76586876-7b4a-47ec-8631-03ce6d935a37 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-76586876-7b4a-47ec-8631-03ce6d935a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:17.511080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:17.512092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:17.512988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:17.512988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:17.512988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:17.514756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 327/656] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:17.520689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7121472-5a98-4ffd-8206-5760bde20f74 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:17.636147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7121472-5a98-4ffd-8206-5760bde20f74 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:17.673380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87835dd1-e5db-46c1-83d8-4e24d4810211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:17.674017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87835dd1-e5db-46c1-83d8-4e24d4810211 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:17.674294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87835dd1-e5db-46c1-83d8-4e24d4810211 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:17.674564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87835dd1-e5db-46c1-83d8-4e24d4810211 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:17.675268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87835dd1-e5db-46c1-83d8-4e24d4810211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:17.675573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87835dd1-e5db-46c1-83d8-4e24d4810211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:17.677484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87835dd1-e5db-46c1-83d8-4e24d4810211 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:17.691675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 330/657] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:17.698154 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586876-7b4a-47ec-8631-03ce6d935a37 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:17.801566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730833b-7e09-4d24-93ed-1af9e8b9a4dc None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:17.802050 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730833b-7e09-4d24-93ed-1af9e8b9a4dc None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:17.802419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730833b-7e09-4d24-93ed-1af9e8b9a4dc None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:17.808172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 331/658] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:17.809990 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4cb4d-c042-4c11-8cf2-f8b551483177 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:17.810378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4cb4d-c042-4c11-8cf2-f8b551483177 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:17.810750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4cb4d-c042-4c11-8cf2-f8b551483177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:17.821501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586876-7b4a-47ec-8631-03ce6d935a37 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:17.831737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-deb4cb4d-c042-4c11-8cf2-f8b551483177 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:17.833208 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-deb4cb4d-c042-4c11-8cf2-f8b551483177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:17.860086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f641c-18e5-42d8-a5b7-8bf1e14667ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:17.861029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f641c-18e5-42d8-a5b7-8bf1e14667ff None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:17.861471 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f641c-18e5-42d8-a5b7-8bf1e14667ff None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:17.861879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f641c-18e5-42d8-a5b7-8bf1e14667ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:17.870149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f641c-18e5-42d8-a5b7-8bf1e14667ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:17.871878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f641c-18e5-42d8-a5b7-8bf1e14667ff None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:17.874785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:17.885022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b63f641c-18e5-42d8-a5b7-8bf1e14667ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:17.886946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:17.887834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:17.889124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:17.889124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:17.889124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:17.889124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:17.889124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:17.889124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:17.889124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:17.889124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:17.889124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 328/659] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:17.896103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f641c-18e5-42d8-a5b7-8bf1e14667ff None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:17.919067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 332/660] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:18.005620 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f641c-18e5-42d8-a5b7-8bf1e14667ff None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:18.043047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1bf37-ea23-4116-a28a-0de6aa6dadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:18.043715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1bf37-ea23-4116-a28a-0de6aa6dadec None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:18.043989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1bf37-ea23-4116-a28a-0de6aa6dadec None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:18.044249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1bf37-ea23-4116-a28a-0de6aa6dadec None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:18.044939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1bf37-ea23-4116-a28a-0de6aa6dadec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:18.045235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1bf37-ea23-4116-a28a-0de6aa6dadec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:18.046651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1bf37-ea23-4116-a28a-0de6aa6dadec None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:18.060166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 329/661] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:18.068244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4cb4d-c042-4c11-8cf2-f8b551483177 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:18.185406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4cb4d-c042-4c11-8cf2-f8b551483177 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:18.196987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1bf37-ea23-4116-a28a-0de6aa6dadec None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:18.232493 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6901-aa3d-45a9-820d-a5a43edb0cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:18.233599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6901-aa3d-45a9-820d-a5a43edb0cd2 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:18.234077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6901-aa3d-45a9-820d-a5a43edb0cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:18.234561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6901-aa3d-45a9-820d-a5a43edb0cd2 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/4c7f48b7688f4bbbb318f0ea8178d5d4/roles/d6bff0c559174ac1bd5c3f26fd124b23` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:18.237196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6901-aa3d-45a9-820d-a5a43edb0cd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=4c7f48b7688f4bbbb318f0ea8178d5d4, role_id=d6bff0c559174ac1bd5c3f26fd124b23)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:18.238872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6901-aa3d-45a9-820d-a5a43edb0cd2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:18.254360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 333/662] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:30:18 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/4c7f48b7688f4bbbb318f0ea8178d5d4/roles/d6bff0c559174ac1bd5c3f26fd124b23 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:30:18.256420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2a80-d793-4729-b5c9-d2e87637ad70 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:18.256908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2a80-d793-4729-b5c9-d2e87637ad70 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:18.257397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2a80-d793-4729-b5c9-d2e87637ad70 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:18.259288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 334/663] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:18.265601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cc5c-8aa2-4474-8b53-bd02a47fca7a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:18.266214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cc5c-8aa2-4474-8b53-bd02a47fca7a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:18.266699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cc5c-8aa2-4474-8b53-bd02a47fca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:18.274040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:18.296138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c6a6cc5c-8aa2-4474-8b53-bd02a47fca7a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:18.297375 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c6a6cc5c-8aa2-4474-8b53-bd02a47fca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:18.333269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1bf37-ea23-4116-a28a-0de6aa6dadec None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:18.350843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:18.396507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2464c-85a3-4783-859f-1d4ddb698e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:18.397213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2464c-85a3-4783-859f-1d4ddb698e70 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:18.397502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2464c-85a3-4783-859f-1d4ddb698e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:18.397773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2464c-85a3-4783-859f-1d4ddb698e70 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:18.398479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2464c-85a3-4783-859f-1d4ddb698e70 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:18.399921 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2464c-85a3-4783-859f-1d4ddb698e70 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:18.407680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 335/664] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:18 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-c9d2464c-85a3-4783-859f-1d4ddb698e70 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:18.414502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:18.415515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:30:18.416498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:18.419538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 330/665] 10.222.0.46 () {56 vars in 1132 bytes} [Mon Oct 24 13:30:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:18.427016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cc5c-8aa2-4474-8b53-bd02a47fca7a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:18.548627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cc5c-8aa2-4474-8b53-bd02a47fca7a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:18.585326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efcb27-dfdf-4641-a174-b3d67b8a32fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:18.585904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efcb27-dfdf-4641-a174-b3d67b8a32fc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:18.586186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efcb27-dfdf-4641-a174-b3d67b8a32fc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:18.586454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efcb27-dfdf-4641-a174-b3d67b8a32fc None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:18.587112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efcb27-dfdf-4641-a174-b3d67b8a32fc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:18.587412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efcb27-dfdf-4641-a174-b3d67b8a32fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:18.588794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efcb27-dfdf-4641-a174-b3d67b8a32fc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:18.599105 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 336/666] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:18.601192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2464c-85a3-4783-859f-1d4ddb698e70 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:18.683074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efcb27-dfdf-4641-a174-b3d67b8a32fc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:18.718948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2464c-85a3-4783-859f-1d4ddb698e70 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:18.731387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:18.746665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:18.758985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105807d-5eee-4444-bb4f-21cd6be7164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:18.759719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105807d-5eee-4444-bb4f-21cd6be7164f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:18.760249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105807d-5eee-4444-bb4f-21cd6be7164f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:18.760369 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105807d-5eee-4444-bb4f-21cd6be7164f None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:18.761123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105807d-5eee-4444-bb4f-21cd6be7164f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:18.761529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105807d-5eee-4444-bb4f-21cd6be7164f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:18.762971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105807d-5eee-4444-bb4f-21cd6be7164f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:18.773621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 331/667] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:18.774717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105807d-5eee-4444-bb4f-21cd6be7164f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:18.822176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efcb27-dfdf-4641-a174-b3d67b8a32fc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:18.870597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013a71e-86af-43a1-b6f4-bfd5b8fcc6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:18.871604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013a71e-86af-43a1-b6f4-bfd5b8fcc6cc None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:18.872031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013a71e-86af-43a1-b6f4-bfd5b8fcc6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:18.872656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013a71e-86af-43a1-b6f4-bfd5b8fcc6cc None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:18.873856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013a71e-86af-43a1-b6f4-bfd5b8fcc6cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:18.875456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013a71e-86af-43a1-b6f4-bfd5b8fcc6cc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:18.889409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105807d-5eee-4444-bb4f-21cd6be7164f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:18.898445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 337/668] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:30:18 2022] POST /identity/v3/services => generated 241 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:18.944502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268207d-2b2e-44a4-b90b-ea861e7919e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:18.945125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268207d-2b2e-44a4-b90b-ea861e7919e7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:18.945438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268207d-2b2e-44a4-b90b-ea861e7919e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:18.945706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268207d-2b2e-44a4-b90b-ea861e7919e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:18.946414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268207d-2b2e-44a4-b90b-ea861e7919e7 None admin] RBAC: Adding query filter params (interface=public, service_id=e9f6e9b9cb374db18e82ea5642b7aadb, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:18.946711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268207d-2b2e-44a4-b90b-ea861e7919e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:18.948190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268207d-2b2e-44a4-b90b-ea861e7919e7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:18.954907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 332/669] 10.222.0.46 () {56 vars in 1251 bytes} [Mon Oct 24 13:30:18 2022] GET /identity/v3/endpoints?service_id=e9f6e9b9cb374db18e82ea5642b7aadb&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:18.961099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013a71e-86af-43a1-b6f4-bfd5b8fcc6cc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:19.080123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:19.085066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013a71e-86af-43a1-b6f4-bfd5b8fcc6cc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:19.124501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f93bd-f2bc-4f2c-9f96-9a283437f20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:19.125353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f93bd-f2bc-4f2c-9f96-9a283437f20a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:19.125779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f93bd-f2bc-4f2c-9f96-9a283437f20a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:19.126181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f93bd-f2bc-4f2c-9f96-9a283437f20a None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:19.126913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f93bd-f2bc-4f2c-9f96-9a283437f20a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:19.128559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f93bd-f2bc-4f2c-9f96-9a283437f20a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:19.135649 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 338/670] 10.222.0.46 () {56 vars in 1087 bytes} [Mon Oct 24 13:30:18 2022] GET /identity/v3/services => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:30:19.464958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41959-31ec-4adc-a115-830638be6dd5 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:19.465477 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41959-31ec-4adc-a115-830638be6dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:19.465842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41959-31ec-4adc-a115-830638be6dd5 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:19.467586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 333/671] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:19.473485 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebed195-c48c-4781-951b-c8db4f23e886 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:19.473926 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebed195-c48c-4781-951b-c8db4f23e886 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:19.474276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebed195-c48c-4781-951b-c8db4f23e886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:19.493610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4ebed195-c48c-4781-951b-c8db4f23e886 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:19.495012 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4ebed195-c48c-4781-951b-c8db4f23e886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:19.573606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 339/672] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:19 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:19.844746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa41959-31ec-4adc-a115-830638be6dd5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:19.910956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:19.964975 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa41959-31ec-4adc-a115-830638be6dd5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:20.005175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76da95-9d74-474c-aca2-03eabec946a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:20.005798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76da95-9d74-474c-aca2-03eabec946a3 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:20.006080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76da95-9d74-474c-aca2-03eabec946a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:20.006357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76da95-9d74-474c-aca2-03eabec946a3 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:20.007093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76da95-9d74-474c-aca2-03eabec946a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:20.008541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76da95-9d74-474c-aca2-03eabec946a3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:20.030884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 334/673] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:30:19 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:20.649978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b807fe-f5a6-4915-875c-c07d5acf1d09 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:20.649978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b807fe-f5a6-4915-875c-c07d5acf1d09 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:20.649978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b807fe-f5a6-4915-875c-c07d5acf1d09 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:20.651302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 340/674] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:20.658971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff01a1-2d86-4f62-a79f-a0ee9220115e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:20.659327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff01a1-2d86-4f62-a79f-a0ee9220115e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:20.659626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff01a1-2d86-4f62-a79f-a0ee9220115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:20.691357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4dff01a1-2d86-4f62-a79f-a0ee9220115e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:20.693298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4dff01a1-2d86-4f62-a79f-a0ee9220115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:20.849537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 335/675] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:21.240647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d191-b9c0-48d3-bc59-400cf66d5745 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:21.240647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d191-b9c0-48d3-bc59-400cf66d5745 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:21.240647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d191-b9c0-48d3-bc59-400cf66d5745 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:21.242408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 341/676] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:21.247995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d191-b9c0-48d3-bc59-400cf66d5745 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:21.252588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353adfa-7c2d-41a2-99d8-848685259ac1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:21.252912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353adfa-7c2d-41a2-99d8-848685259ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:21.253185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353adfa-7c2d-41a2-99d8-848685259ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:21.272115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4353adfa-7c2d-41a2-99d8-848685259ac1 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:21.273317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4353adfa-7c2d-41a2-99d8-848685259ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:21.302416 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:21.347921 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:21.349788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 336/677] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:21.361194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d191-b9c0-48d3-bc59-400cf66d5745 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:21.409074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1351-a872-4225-b14d-ab8c88f35b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:21.410143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1351-a872-4225-b14d-ab8c88f35b16 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:21.410627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1351-a872-4225-b14d-ab8c88f35b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:21.411190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1351-a872-4225-b14d-ab8c88f35b16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:21.426618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1351-a872-4225-b14d-ab8c88f35b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-bb3b1351-a872-4225-b14d-ab8c88f35b16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:21.431555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:21.432503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:21.433340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 342/678] 10.222.0.46 () {56 vars in 1120 bytes} [Mon Oct 24 13:30:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:21.440318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353adfa-7c2d-41a2-99d8-848685259ac1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:21.554900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353adfa-7c2d-41a2-99d8-848685259ac1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:21.591173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f36ab1-594b-41c7-9f79-48833b11a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:21.592163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f36ab1-594b-41c7-9f79-48833b11a9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:21.592846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f36ab1-594b-41c7-9f79-48833b11a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:21.593266 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f36ab1-594b-41c7-9f79-48833b11a9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:21.594085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f36ab1-594b-41c7-9f79-48833b11a9a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:21.594538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f36ab1-594b-41c7-9f79-48833b11a9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:21.596173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f36ab1-594b-41c7-9f79-48833b11a9a2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:21.600538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2373-1bf4-45bb-bdb0-09e24baf0081 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:21.600822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2373-1bf4-45bb-bdb0-09e24baf0081 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:21.601102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2373-1bf4-45bb-bdb0-09e24baf0081 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:21.606430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 337/679] 10.222.0.46 () {56 vars in 1115 bytes} [Mon Oct 24 13:30:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:21.612657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 343/680] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:21.612793 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c09d5-386b-4054-be10-ba2ac9751450 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:21.612793 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c09d5-386b-4054-be10-ba2ac9751450 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:21.612941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c09d5-386b-4054-be10-ba2ac9751450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:21.614591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed2373-1bf4-45bb-bdb0-09e24baf0081 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:21.636710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-af4c09d5-386b-4054-be10-ba2ac9751450 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:21.638236 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-af4c09d5-386b-4054-be10-ba2ac9751450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:21.662977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:21.718262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 338/681] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:21.718262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c09d5-386b-4054-be10-ba2ac9751450 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:21.732230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed2373-1bf4-45bb-bdb0-09e24baf0081 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:21.780275 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af0c06-ac05-469a-b431-7edc9dfe59ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:21.781175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af0c06-ac05-469a-b431-7edc9dfe59ea None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:21.781546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af0c06-ac05-469a-b431-7edc9dfe59ea None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:21.781912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af0c06-ac05-469a-b431-7edc9dfe59ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:21.793866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af0c06-ac05-469a-b431-7edc9dfe59ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:21.795583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af0c06-ac05-469a-b431-7edc9dfe59ea None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-13af0c06-ac05-469a-b431-7edc9dfe59ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:21.811949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:21.813118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:21.814009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:21.814009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:21.814009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:21.814980 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 344/682] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:21.821423 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af0c06-ac05-469a-b431-7edc9dfe59ea None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:21.832624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c09d5-386b-4054-be10-ba2ac9751450 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:21.835226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:21.873748 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efca49-ee11-40f2-a2ab-e913b27073d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:21.875076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efca49-ee11-40f2-a2ab-e913b27073d9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:21.875557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efca49-ee11-40f2-a2ab-e913b27073d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:21.875998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efca49-ee11-40f2-a2ab-e913b27073d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:21.876758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efca49-ee11-40f2-a2ab-e913b27073d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:21.878310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efca49-ee11-40f2-a2ab-e913b27073d9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b9efca49-ee11-40f2-a2ab-e913b27073d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:21.888038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:21.889091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:21.889986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:21.897907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 339/683] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:21.899113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efca49-ee11-40f2-a2ab-e913b27073d9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:21.922984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:21.965401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af0c06-ac05-469a-b431-7edc9dfe59ea None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.009405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30778b39-3743-427c-ba4d-81328c599d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.010017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778b39-3743-427c-ba4d-81328c599d8e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.010294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778b39-3743-427c-ba4d-81328c599d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.010562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778b39-3743-427c-ba4d-81328c599d8e None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.011232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30778b39-3743-427c-ba4d-81328c599d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:22.011533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30778b39-3743-427c-ba4d-81328c599d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.012913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30778b39-3743-427c-ba4d-81328c599d8e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.016801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efca49-ee11-40f2-a2ab-e913b27073d9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.030114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 345/684] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:22.030114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30778b39-3743-427c-ba4d-81328c599d8e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.060742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb92a-eca8-415e-90b3-cdc177cd6c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.061359 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb92a-eca8-415e-90b3-cdc177cd6c09 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.061632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb92a-eca8-415e-90b3-cdc177cd6c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.061900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb92a-eca8-415e-90b3-cdc177cd6c09 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.062608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bb92a-eca8-415e-90b3-cdc177cd6c09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:22.062839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bb92a-eca8-415e-90b3-cdc177cd6c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.064245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bb92a-eca8-415e-90b3-cdc177cd6c09 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.070221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 340/685] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:22.070881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb92a-eca8-415e-90b3-cdc177cd6c09 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.099969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:22.141570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30778b39-3743-427c-ba4d-81328c599d8e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.166068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:22.178188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0bab-5c84-414c-8c5e-42e35497c0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.178815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0bab-5c84-414c-8c5e-42e35497c0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.179157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0bab-5c84-414c-8c5e-42e35497c0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.179462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0bab-5c84-414c-8c5e-42e35497c0c2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.179993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb0bab-5c84-414c-8c5e-42e35497c0c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.181379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb0bab-5c84-414c-8c5e-42e35497c0c2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.184675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb92a-eca8-415e-90b3-cdc177cd6c09 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-9cbb0bab-5c84-414c-8c5e-42e35497c0c2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:22.190424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:22.191584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:22.192601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 346/686] 10.222.0.46 () {56 vars in 1132 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:22.193389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0bab-5c84-414c-8c5e-42e35497c0c2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.231225 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7034b-e92f-4a3d-8706-e7214883d9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.231896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7034b-e92f-4a3d-8706-e7214883d9cf None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.232169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7034b-e92f-4a3d-8706-e7214883d9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.232429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7034b-e92f-4a3d-8706-e7214883d9cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.242553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7034b-e92f-4a3d-8706-e7214883d9cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.244167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7034b-e92f-4a3d-8706-e7214883d9cf None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-c2c7034b-e92f-4a3d-8706-e7214883d9cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:22.256093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:22.257064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 341/687] 10.222.0.46 () {56 vars in 1117 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:22.258001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7034b-e92f-4a3d-8706-e7214883d9cf None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.306970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0bab-5c84-414c-8c5e-42e35497c0c2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.336150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:22.345248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48911fc3-988c-4272-baff-fad13e8868e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.345834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48911fc3-988c-4272-baff-fad13e8868e5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.346104 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48911fc3-988c-4272-baff-fad13e8868e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.346366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48911fc3-988c-4272-baff-fad13e8868e5 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.347011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48911fc3-988c-4272-baff-fad13e8868e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:22.347306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48911fc3-988c-4272-baff-fad13e8868e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.348885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48911fc3-988c-4272-baff-fad13e8868e5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.354313 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 347/688] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:22.354313 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48911fc3-988c-4272-baff-fad13e8868e5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.387839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7034b-e92f-4a3d-8706-e7214883d9cf None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.429344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aea86-942b-413e-8c91-e9f5aaf9333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.429945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aea86-942b-413e-8c91-e9f5aaf9333c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.430223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aea86-942b-413e-8c91-e9f5aaf9333c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.430484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aea86-942b-413e-8c91-e9f5aaf9333c None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.431137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aea86-942b-413e-8c91-e9f5aaf9333c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:22.431449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aea86-942b-413e-8c91-e9f5aaf9333c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.432811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aea86-942b-413e-8c91-e9f5aaf9333c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.442960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 342/689] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:22.442960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aea86-942b-413e-8c91-e9f5aaf9333c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.455303 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:22.472510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48911fc3-988c-4272-baff-fad13e8868e5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.508976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad35b1c-bc1b-4ae0-94d8-17059419aefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.509585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad35b1c-bc1b-4ae0-94d8-17059419aefb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.509856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad35b1c-bc1b-4ae0-94d8-17059419aefb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.510117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad35b1c-bc1b-4ae0-94d8-17059419aefb None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.510828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad35b1c-bc1b-4ae0-94d8-17059419aefb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:22.511151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad35b1c-bc1b-4ae0-94d8-17059419aefb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.512584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad35b1c-bc1b-4ae0-94d8-17059419aefb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.530558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 348/690] 10.222.0.46 () {56 vars in 1149 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:22.531408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad35b1c-bc1b-4ae0-94d8-17059419aefb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.550866 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aea86-942b-413e-8c91-e9f5aaf9333c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.579747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:22.585061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4483-4ac6-499e-9c52-cfc1ac979a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.585679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4483-4ac6-499e-9c52-cfc1ac979a3f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.585949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4483-4ac6-499e-9c52-cfc1ac979a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.586256 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4483-4ac6-499e-9c52-cfc1ac979a3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.586905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4483-4ac6-499e-9c52-cfc1ac979a3f None admin] RBAC: Adding query filter params (interface=public, service_id=579aa3238da34007b1744717cfd940ba, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:22.587454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4483-4ac6-499e-9c52-cfc1ac979a3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.588580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4483-4ac6-499e-9c52-cfc1ac979a3f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.593632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 343/691] 10.222.0.46 () {56 vars in 1251 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/endpoints?service_id=579aa3238da34007b1744717cfd940ba&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:22.594773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9fdf-4eff-414d-a08f-83d66b21ca0d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.595211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9fdf-4eff-414d-a08f-83d66b21ca0d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.595342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9fdf-4eff-414d-a08f-83d66b21ca0d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.599045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 344/692] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:22.599045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad9fdf-4eff-414d-a08f-83d66b21ca0d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.631112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad35b1c-bc1b-4ae0-94d8-17059419aefb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.665477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1dacb-4bfa-4771-a4b7-68c24b001917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.666082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1dacb-4bfa-4771-a4b7-68c24b001917 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.666348 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1dacb-4bfa-4771-a4b7-68c24b001917 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.666610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1dacb-4bfa-4771-a4b7-68c24b001917 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.667271 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1dacb-4bfa-4771-a4b7-68c24b001917 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:22.667554 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1dacb-4bfa-4771-a4b7-68c24b001917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.668917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1dacb-4bfa-4771-a4b7-68c24b001917 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.670694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:22.674243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 349/693] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:22.675336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1dacb-4bfa-4771-a4b7-68c24b001917 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.702762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad9fdf-4eff-414d-a08f-83d66b21ca0d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.735728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f67af-8942-4b59-9cca-4b1648c62fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.736346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f67af-8942-4b59-9cca-4b1648c62fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.736622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f67af-8942-4b59-9cca-4b1648c62fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.736894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f67af-8942-4b59-9cca-4b1648c62fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.777191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1dacb-4bfa-4771-a4b7-68c24b001917 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:22.790566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:22.807200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f67af-8942-4b59-9cca-4b1648c62fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.808751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f67af-8942-4b59-9cca-4b1648c62fd7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.812045 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785a8ed-9cd6-41c1-960a-98611848494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:22.812656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a8ed-9cd6-41c1-960a-98611848494f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.812935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a8ed-9cd6-41c1-960a-98611848494f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.813204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a8ed-9cd6-41c1-960a-98611848494f None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.813802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785a8ed-9cd6-41c1-960a-98611848494f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:22.815198 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785a8ed-9cd6-41c1-960a-98611848494f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:22.821446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 350/694] 10.222.0.46 () {56 vars in 1087 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:30:22.822672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988f761-11ab-46eb-9f45-f86d1e21e21c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:22.822992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988f761-11ab-46eb-9f45-f86d1e21e21c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:22.823248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988f761-11ab-46eb-9f45-f86d1e21e21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:22.856558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1988f761-11ab-46eb-9f45-f86d1e21e21c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:22.857870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1988f761-11ab-46eb-9f45-f86d1e21e21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:22.888294 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:22.931076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 345/695] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:30:22.931076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f67af-8942-4b59-9cca-4b1648c62fd7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:22.945644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 351/696] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:22.955157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988f761-11ab-46eb-9f45-f86d1e21e21c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:23.076058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f67af-8942-4b59-9cca-4b1648c62fd7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:23.078086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988f761-11ab-46eb-9f45-f86d1e21e21c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:23.093239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:23.120334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13036d0-2e86-4b91-bc0e-dddbcc22300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:23.121033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13036d0-2e86-4b91-bc0e-dddbcc22300c None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:23.121312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13036d0-2e86-4b91-bc0e-dddbcc22300c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:23.121576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13036d0-2e86-4b91-bc0e-dddbcc22300c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:23.122249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13036d0-2e86-4b91-bc0e-dddbcc22300c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:23.123634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13036d0-2e86-4b91-bc0e-dddbcc22300c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:23.133148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db6bb5-3522-4f2b-b488-862353136612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:23.134189 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db6bb5-3522-4f2b-b488-862353136612 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:23.135094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db6bb5-3522-4f2b-b488-862353136612 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:23.135734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db6bb5-3522-4f2b-b488-862353136612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:23.148519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db6bb5-3522-4f2b-b488-862353136612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:23.150748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db6bb5-3522-4f2b-b488-862353136612 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:23.155169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 346/697] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:30:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-36db6bb5-3522-4f2b-b488-862353136612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:23.172742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:23.173806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:23.174725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:23.174725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:23.174725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:23.176899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 352/698] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:23.183141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13036d0-2e86-4b91-bc0e-dddbcc22300c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:23.219445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:23.232380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db6bb5-3522-4f2b-b488-862353136612 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:23.323094 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13036d0-2e86-4b91-bc0e-dddbcc22300c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:23.356966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db6bb5-3522-4f2b-b488-862353136612 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:23.369916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d2105-1083-4a9a-964e-5cbca408bb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:23.370758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d2105-1083-4a9a-964e-5cbca408bb66 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:23.371362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d2105-1083-4a9a-964e-5cbca408bb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:23.371740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d2105-1083-4a9a-964e-5cbca408bb66 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:23.372983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d2105-1083-4a9a-964e-5cbca408bb66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:23.373391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d2105-1083-4a9a-964e-5cbca408bb66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:23.375312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d2105-1083-4a9a-964e-5cbca408bb66 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:23.390483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 347/699] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:23.397111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d2105-1083-4a9a-964e-5cbca408bb66 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:23.400561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e61e59-df6e-4a9e-8683-334a9bdc41f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:23.401687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e61e59-df6e-4a9e-8683-334a9bdc41f6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:23.401687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e61e59-df6e-4a9e-8683-334a9bdc41f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:23.401687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e61e59-df6e-4a9e-8683-334a9bdc41f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:23.402237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e61e59-df6e-4a9e-8683-334a9bdc41f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:23.403646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e61e59-df6e-4a9e-8683-334a9bdc41f6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b4e61e59-df6e-4a9e-8683-334a9bdc41f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:23.415414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:23.416522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:23.417403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 353/700] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:30:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:23.426534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e61e59-df6e-4a9e-8683-334a9bdc41f6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:23.467914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:23.515286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:23.552102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d2105-1083-4a9a-964e-5cbca408bb66 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:23.563264 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e61e59-df6e-4a9e-8683-334a9bdc41f6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:23.595394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b26bbe-b520-40c9-9834-76942f5e5cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:23.596474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b26bbe-b520-40c9-9834-76942f5e5cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:23.596966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b26bbe-b520-40c9-9834-76942f5e5cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:23.597426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b26bbe-b520-40c9-9834-76942f5e5cd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:23.598580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371d64-cb69-4780-a2ad-09e3dd2f7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:23.599244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371d64-cb69-4780-a2ad-09e3dd2f7f80 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:23.599599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371d64-cb69-4780-a2ad-09e3dd2f7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:23.599866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371d64-cb69-4780-a2ad-09e3dd2f7f80 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:23.600499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371d64-cb69-4780-a2ad-09e3dd2f7f80 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:23.600860 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371d64-cb69-4780-a2ad-09e3dd2f7f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:23.602244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371d64-cb69-4780-a2ad-09e3dd2f7f80 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:23.607581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b26bbe-b520-40c9-9834-76942f5e5cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:23.607733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 354/701] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:30:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:23.609386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b26bbe-b520-40c9-9834-76942f5e5cd2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:23.615978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371d64-cb69-4780-a2ad-09e3dd2f7f80 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b2b26bbe-b520-40c9-9834-76942f5e5cd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:23.623982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:23.624862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:23.625749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:23.625749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:23.625749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:23.625749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:23.625749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:23.625749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:23.625749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:23.625749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:23.625749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 348/702] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:23.633040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b26bbe-b520-40c9-9834-76942f5e5cd2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:23.744768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:23.765857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371d64-cb69-4780-a2ad-09e3dd2f7f80 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:23.766299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b26bbe-b520-40c9-9834-76942f5e5cd2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:23.805834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a910e23-0320-4ee6-8eae-85ebbada528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:23.806568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a910e23-0320-4ee6-8eae-85ebbada528d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:23.806760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a910e23-0320-4ee6-8eae-85ebbada528d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:23.807062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a910e23-0320-4ee6-8eae-85ebbada528d None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:23.807692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a910e23-0320-4ee6-8eae-85ebbada528d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:23.807994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a910e23-0320-4ee6-8eae-85ebbada528d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:23.809374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a910e23-0320-4ee6-8eae-85ebbada528d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:23.810836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340704f-0f6e-4490-9838-46ed2f8f1e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:23.811838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340704f-0f6e-4490-9838-46ed2f8f1e63 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:23.812322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340704f-0f6e-4490-9838-46ed2f8f1e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:23.812740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340704f-0f6e-4490-9838-46ed2f8f1e63 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:23.813629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340704f-0f6e-4490-9838-46ed2f8f1e63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:23.814079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340704f-0f6e-4490-9838-46ed2f8f1e63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:23.815688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340704f-0f6e-4490-9838-46ed2f8f1e63 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:23.820673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 355/703] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:30:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:23.821729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a910e23-0320-4ee6-8eae-85ebbada528d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:23.838870 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 349/704] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:30:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:23.841112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340704f-0f6e-4490-9838-46ed2f8f1e63 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:23.845296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:23.964043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a910e23-0320-4ee6-8eae-85ebbada528d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:23.987974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340704f-0f6e-4490-9838-46ed2f8f1e63 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:24.011994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f448a0-f7f1-4bd6-bbd4-74766bc23a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:24.012611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f448a0-f7f1-4bd6-bbd4-74766bc23a22 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:24.012888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f448a0-f7f1-4bd6-bbd4-74766bc23a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:24.013153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f448a0-f7f1-4bd6-bbd4-74766bc23a22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:24.014323 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f448a0-f7f1-4bd6-bbd4-74766bc23a22 None admin] RBAC: Adding query filter params (interface=public, service_id=d037dbdb896647a0b7bef7cfe2492577, region_id=RegionOne) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:24.014633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f448a0-f7f1-4bd6-bbd4-74766bc23a22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:24.016547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f448a0-f7f1-4bd6-bbd4-74766bc23a22 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:24.028982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 356/705] 10.222.0.46 () {56 vars in 1251 bytes} [Mon Oct 24 13:30:23 2022] GET /identity/v3/endpoints?service_id=d037dbdb896647a0b7bef7cfe2492577&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:24.029958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f448a0-f7f1-4bd6-bbd4-74766bc23a22 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:24.032292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd7bf3-3548-4860-b362-026a52ec6c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:24.033200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd7bf3-3548-4860-b362-026a52ec6c1e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:24.033472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd7bf3-3548-4860-b362-026a52ec6c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:24.034685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd7bf3-3548-4860-b362-026a52ec6c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:24.035506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd7bf3-3548-4860-b362-026a52ec6c1e None admin] RBAC: Adding query filter params (role.id=d6bff0c559174ac1bd5c3f26fd124b23, scope.project.id=11342796e85b428195cf5155b512162c, user.id=4c7f48b7688f4bbbb318f0ea8178d5d4) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:24.036028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd7bf3-3548-4860-b362-026a52ec6c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:24.037465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd7bf3-3548-4860-b362-026a52ec6c1e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:24.045086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 350/706] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:30:23 2022] GET /identity/v3/role_assignments?user.id=4c7f48b7688f4bbbb318f0ea8178d5d4&scope.project.id=11342796e85b428195cf5155b512162c&role.id=d6bff0c559174ac1bd5c3f26fd124b23 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:24.055173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:24.157064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f448a0-f7f1-4bd6-bbd4-74766bc23a22 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:24.199794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80483f4c-d890-4f1b-bc99-6c9ba70b1c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:24.202969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80483f4c-d890-4f1b-bc99-6c9ba70b1c92 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:24.202969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80483f4c-d890-4f1b-bc99-6c9ba70b1c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:24.202969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80483f4c-d890-4f1b-bc99-6c9ba70b1c92 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:24.202969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80483f4c-d890-4f1b-bc99-6c9ba70b1c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:24.203362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80483f4c-d890-4f1b-bc99-6c9ba70b1c92 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:24.210975 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 357/707] 10.222.0.46 () {56 vars in 1087 bytes} [Mon Oct 24 13:30:24 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:30:25.084347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086386f-ed57-4996-be76-0dc8963925b7 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:25.084882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086386f-ed57-4996-be76-0dc8963925b7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:25.084882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086386f-ed57-4996-be76-0dc8963925b7 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:25.086440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 351/708] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:25.092180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c95d-e2a4-4ad8-9311-e03896db73e5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:25.092646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c95d-e2a4-4ad8-9311-e03896db73e5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:25.092724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c95d-e2a4-4ad8-9311-e03896db73e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:25.112125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ff29c95d-e2a4-4ad8-9311-e03896db73e5 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:25.113303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ff29c95d-e2a4-4ad8-9311-e03896db73e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:25.183260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 358/709] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:25.467272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086386f-ed57-4996-be76-0dc8963925b7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:25.537017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:25.540939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab6e93-f2f2-4338-9da4-bdaedf9d9383 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:25.541237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab6e93-f2f2-4338-9da4-bdaedf9d9383 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:25.541508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab6e93-f2f2-4338-9da4-bdaedf9d9383 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:25.543303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 359/710] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:30:25.549521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a455824-a9c7-4432-91d5-602ed2356099 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:25.549803 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a455824-a9c7-4432-91d5-602ed2356099 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:25.550076 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a455824-a9c7-4432-91d5-602ed2356099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:25.571837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0a455824-a9c7-4432-91d5-602ed2356099 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:25.572977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0a455824-a9c7-4432-91d5-602ed2356099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:25.575269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:25.591472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086386f-ed57-4996-be76-0dc8963925b7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:25.637299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e88f5-ac53-478b-bada-3ee5a24038df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:25.638874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e88f5-ac53-478b-bada-3ee5a24038df None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:25.639353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e88f5-ac53-478b-bada-3ee5a24038df None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:25.639787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e88f5-ac53-478b-bada-3ee5a24038df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:25.641157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e88f5-ac53-478b-bada-3ee5a24038df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:25.642975 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e88f5-ac53-478b-bada-3ee5a24038df None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:25.651253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 360/711] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-0c2e88f5-ac53-478b-bada-3ee5a24038df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:25.653240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:25.654200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:25.655097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:25.657312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 352/712] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:25.664005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a455824-a9c7-4432-91d5-602ed2356099 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:25.765649 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a455824-a9c7-4432-91d5-602ed2356099 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:25.806162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab146c4b-04b7-40c7-8174-81deee996859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:25.807145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab146c4b-04b7-40c7-8174-81deee996859 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:25.807678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab146c4b-04b7-40c7-8174-81deee996859 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:25.808095 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab146c4b-04b7-40c7-8174-81deee996859 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:25.808844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab146c4b-04b7-40c7-8174-81deee996859 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:25.809261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab146c4b-04b7-40c7-8174-81deee996859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:25.810759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab146c4b-04b7-40c7-8174-81deee996859 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:25.816448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 361/713] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:25.822653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e88f5-ac53-478b-bada-3ee5a24038df None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:25.931418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e88f5-ac53-478b-bada-3ee5a24038df None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:25.932055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab146c4b-04b7-40c7-8174-81deee996859 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:25.935320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:25.976134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:25.982847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532324fb-ab31-4438-b021-32ac4e96eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:25.983683 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532324fb-ab31-4438-b021-32ac4e96eb1a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:25.984300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532324fb-ab31-4438-b021-32ac4e96eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:25.984874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532324fb-ab31-4438-b021-32ac4e96eb1a None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:25.986104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532324fb-ab31-4438-b021-32ac4e96eb1a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:25.986989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532324fb-ab31-4438-b021-32ac4e96eb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:25.988775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532324fb-ab31-4438-b021-32ac4e96eb1a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:25.995936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 353/714] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:26.001559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532324fb-ab31-4438-b021-32ac4e96eb1a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:26.059515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab146c4b-04b7-40c7-8174-81deee996859 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:26.098391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ac41-8464-44d6-85fe-af77d701f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:26.099957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ac41-8464-44d6-85fe-af77d701f014 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:26.100476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ac41-8464-44d6-85fe-af77d701f014 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:26.100974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ac41-8464-44d6-85fe-af77d701f014 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:26.101725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4ac41-8464-44d6-85fe-af77d701f014 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:26.103390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4ac41-8464-44d6-85fe-af77d701f014 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ddb4ac41-8464-44d6-85fe-af77d701f014 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:26.115331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:26.116351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:30:26.117204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:26.117951 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532324fb-ab31-4438-b021-32ac4e96eb1a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:26.125006 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 362/715] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:26.126272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ac41-8464-44d6-85fe-af77d701f014 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:26.154310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25123f8-a935-4935-a7ff-6a346fa07288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:26.155111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25123f8-a935-4935-a7ff-6a346fa07288 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:26.155711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25123f8-a935-4935-a7ff-6a346fa07288 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:26.155711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25123f8-a935-4935-a7ff-6a346fa07288 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:26.156631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25123f8-a935-4935-a7ff-6a346fa07288 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:26.158098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25123f8-a935-4935-a7ff-6a346fa07288 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:26.187324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 354/716] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:30:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:30:26.214813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:26.263436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ac41-8464-44d6-85fe-af77d701f014 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:26.315782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1f572-2dc9-41df-8b9e-2d18d68ca766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:26.316567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1f572-2dc9-41df-8b9e-2d18d68ca766 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:26.316983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1f572-2dc9-41df-8b9e-2d18d68ca766 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:26.317334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1f572-2dc9-41df-8b9e-2d18d68ca766 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:26.318082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1f572-2dc9-41df-8b9e-2d18d68ca766 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:26.318466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1f572-2dc9-41df-8b9e-2d18d68ca766 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:26.320066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1f572-2dc9-41df-8b9e-2d18d68ca766 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:26.330893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 363/717] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:26.337807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25123f8-a935-4935-a7ff-6a346fa07288 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:26.338474 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d1353-51f3-4b51-bb08-509be9dbc3d7 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:26.338753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d1353-51f3-4b51-bb08-509be9dbc3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:26.339038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d1353-51f3-4b51-bb08-509be9dbc3d7 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:26.340704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 364/718] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:26.346435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c85b-b396-4454-a27c-83a979c367f2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:26.346762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c85b-b396-4454-a27c-83a979c367f2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:26.347008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c85b-b396-4454-a27c-83a979c367f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:26.371580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4fe0c85b-b396-4454-a27c-83a979c367f2 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:26.373833 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4fe0c85b-b396-4454-a27c-83a979c367f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:26.431346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:26.487891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 365/719] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:26.503163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25123f8-a935-4935-a7ff-6a346fa07288 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:26.539200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d6904-2707-400a-989b-6dc46091a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:26.539821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6904-2707-400a-989b-6dc46091a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:26.540093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6904-2707-400a-989b-6dc46091a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:26.540364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6904-2707-400a-989b-6dc46091a6b1 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:26.540993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d6904-2707-400a-989b-6dc46091a6b1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:26.541287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d6904-2707-400a-989b-6dc46091a6b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:26.542657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d6904-2707-400a-989b-6dc46091a6b1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:26.544746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cca08-f1ff-451d-9312-02a63a89bd1f None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:26.545030 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cca08-f1ff-451d-9312-02a63a89bd1f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:26.545305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cca08-f1ff-451d-9312-02a63a89bd1f None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:26.546905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 366/720] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:30:26.547879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 355/721] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:26.552699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ab819-59e2-4b39-8586-358d13702e9f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:26.553001 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ab819-59e2-4b39-8586-358d13702e9f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:26.553229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ab819-59e2-4b39-8586-358d13702e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:26.574319 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b67ab819-59e2-4b39-8586-358d13702e9f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:26.575631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b67ab819-59e2-4b39-8586-358d13702e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:26.646229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:26.668008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 367/722] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:26.767470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d6904-2707-400a-989b-6dc46091a6b1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:26.877555 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d6904-2707-400a-989b-6dc46091a6b1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:26.894626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:26.914956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfcae6-57ef-46fe-ae92-1c10ff0272c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:26.918965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfcae6-57ef-46fe-ae92-1c10ff0272c9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:26.918965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfcae6-57ef-46fe-ae92-1c10ff0272c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:26.918965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfcae6-57ef-46fe-ae92-1c10ff0272c9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:26.918965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfcae6-57ef-46fe-ae92-1c10ff0272c9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:26.918965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfcae6-57ef-46fe-ae92-1c10ff0272c9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-9dcfcae6-57ef-46fe-ae92-1c10ff0272c9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:26.927527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:26.928503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:26.929723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 356/723] 10.222.0.46 () {56 vars in 1105 bytes} [Mon Oct 24 13:30:26 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:26.937018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ab819-59e2-4b39-8586-358d13702e9f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:26.958643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfcae6-57ef-46fe-ae92-1c10ff0272c9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:27.064101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ab819-59e2-4b39-8586-358d13702e9f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:27.084658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfcae6-57ef-46fe-ae92-1c10ff0272c9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:27.102218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9651b-f513-4e59-a626-05f2e5e6ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:27.102887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9651b-f513-4e59-a626-05f2e5e6ffa0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:27.103128 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9651b-f513-4e59-a626-05f2e5e6ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:27.103393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9651b-f513-4e59-a626-05f2e5e6ffa0 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:27.104155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9651b-f513-4e59-a626-05f2e5e6ffa0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:27.104450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9651b-f513-4e59-a626-05f2e5e6ffa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:27.105958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9651b-f513-4e59-a626-05f2e5e6ffa0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:27.121238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 368/724] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:27.123113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9651b-f513-4e59-a626-05f2e5e6ffa0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:27.134683 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f7fe2-5fe5-4909-8916-e3e592d11397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:27.136011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7fe2-5fe5-4909-8916-e3e592d11397 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:27.137012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7fe2-5fe5-4909-8916-e3e592d11397 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:27.137473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7fe2-5fe5-4909-8916-e3e592d11397 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:27.138269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f7fe2-5fe5-4909-8916-e3e592d11397 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:27.140721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f7fe2-5fe5-4909-8916-e3e592d11397 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-206f7fe2-5fe5-4909-8916-e3e592d11397 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:27.153115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:27.154188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:27.155058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 357/725] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:30:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:27.162185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f7fe2-5fe5-4909-8916-e3e592d11397 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:27.190461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:27.220811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:27.251905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9651b-f513-4e59-a626-05f2e5e6ffa0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:27.289766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebeaf6-d20c-4320-bac6-9586bb6a2785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:27.290403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebeaf6-d20c-4320-bac6-9586bb6a2785 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:27.290673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebeaf6-d20c-4320-bac6-9586bb6a2785 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:27.290950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebeaf6-d20c-4320-bac6-9586bb6a2785 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:27.291725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebeaf6-d20c-4320-bac6-9586bb6a2785 None admin] RBAC: Adding query filter params (type=image) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:27.291992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebeaf6-d20c-4320-bac6-9586bb6a2785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:27.293455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebeaf6-d20c-4320-bac6-9586bb6a2785 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:27.298982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 369/726] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:27.309322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f7fe2-5fe5-4909-8916-e3e592d11397 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:27.356191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c3c84-8f07-40fe-9731-ad8de1e693a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:27.357082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c3c84-8f07-40fe-9731-ad8de1e693a6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:27.357494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c3c84-8f07-40fe-9731-ad8de1e693a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:27.357895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c3c84-8f07-40fe-9731-ad8de1e693a6 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:27.358668 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c3c84-8f07-40fe-9731-ad8de1e693a6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:27.359140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c3c84-8f07-40fe-9731-ad8de1e693a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:27.360784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c3c84-8f07-40fe-9731-ad8de1e693a6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:27.367463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 358/727] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:30:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:27.373633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebeaf6-d20c-4320-bac6-9586bb6a2785 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:27.495202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebeaf6-d20c-4320-bac6-9586bb6a2785 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:27.515363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:27.536895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c0d0d-e9e8-4f1e-bc64-0a2fe5499d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:27.537104 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c0d0d-e9e8-4f1e-bc64-0a2fe5499d38 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:27.537378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c0d0d-e9e8-4f1e-bc64-0a2fe5499d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:27.537536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c0d0d-e9e8-4f1e-bc64-0a2fe5499d38 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:27.538158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c0d0d-e9e8-4f1e-bc64-0a2fe5499d38 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:27.538451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c0d0d-e9e8-4f1e-bc64-0a2fe5499d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:27.539877 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c0d0d-e9e8-4f1e-bc64-0a2fe5499d38 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:27.545119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 370/728] 10.222.0.46 () {56 vars in 1114 bytes} [Mon Oct 24 13:30:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:27.551581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c3c84-8f07-40fe-9731-ad8de1e693a6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:27.661041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c3c84-8f07-40fe-9731-ad8de1e693a6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:27.670502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:27.696135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6058e2d-a13c-4358-b954-d576cfc3532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:27.696744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6058e2d-a13c-4358-b954-d576cfc3532a None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:27.697014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6058e2d-a13c-4358-b954-d576cfc3532a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:27.697279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6058e2d-a13c-4358-b954-d576cfc3532a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:27.697957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6058e2d-a13c-4358-b954-d576cfc3532a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:27.699353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6058e2d-a13c-4358-b954-d576cfc3532a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:27.731137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 359/729] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:30:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:28.579028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de241e46-2886-4f3f-a76f-ca8fe8d7529e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:28.579695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de241e46-2886-4f3f-a76f-ca8fe8d7529e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:28.579695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de241e46-2886-4f3f-a76f-ca8fe8d7529e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:28.581170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 371/730] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:28.587201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1bc47-206b-4694-b294-43a9aa871163 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:28.587624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1bc47-206b-4694-b294-43a9aa871163 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:28.587797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1bc47-206b-4694-b294-43a9aa871163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:28.606813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c2b1bc47-206b-4694-b294-43a9aa871163 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:28.608051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c2b1bc47-206b-4694-b294-43a9aa871163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:28.696885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 360/731] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:28.792888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fca2f2-dd80-4ef7-a29d-7083766388b3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:28.793227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fca2f2-dd80-4ef7-a29d-7083766388b3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:28.793429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fca2f2-dd80-4ef7-a29d-7083766388b3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:28.795052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 372/732] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:28.800506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820a6c-0bd5-4a55-9085-ecd3bf50b29a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:28.800789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820a6c-0bd5-4a55-9085-ecd3bf50b29a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:28.801115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820a6c-0bd5-4a55-9085-ecd3bf50b29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:28.820159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5b820a6c-0bd5-4a55-9085-ecd3bf50b29a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:28.821332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5b820a6c-0bd5-4a55-9085-ecd3bf50b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:28.894487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 361/733] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:28.975511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fca2f2-dd80-4ef7-a29d-7083766388b3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:29.089662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fca2f2-dd80-4ef7-a29d-7083766388b3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:29.126688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccf738-06f2-4f12-8f26-eaf027ed8380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:29.127434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccf738-06f2-4f12-8f26-eaf027ed8380 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:29.127755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccf738-06f2-4f12-8f26-eaf027ed8380 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:29.128024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccf738-06f2-4f12-8f26-eaf027ed8380 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:29.128610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccf738-06f2-4f12-8f26-eaf027ed8380 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:29.130376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccf738-06f2-4f12-8f26-eaf027ed8380 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-eeccf738-06f2-4f12-8f26-eaf027ed8380 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:29.139640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:29.140664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:29.141543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 373/734] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:29.147495 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b820a6c-0bd5-4a55-9085-ecd3bf50b29a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:29.166339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccf738-06f2-4f12-8f26-eaf027ed8380 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:29.175239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:29.225681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:29.274446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b820a6c-0bd5-4a55-9085-ecd3bf50b29a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:29.302762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccf738-06f2-4f12-8f26-eaf027ed8380 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:29.318459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64c06-fd72-43a8-b909-d3140f9e5650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:29.319237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64c06-fd72-43a8-b909-d3140f9e5650 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:29.319584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64c06-fd72-43a8-b909-d3140f9e5650 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:29.319987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64c06-fd72-43a8-b909-d3140f9e5650 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:29.320605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f64c06-fd72-43a8-b909-d3140f9e5650 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:29.320966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f64c06-fd72-43a8-b909-d3140f9e5650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:29.322489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f64c06-fd72-43a8-b909-d3140f9e5650 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:29.330967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 362/735] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:29.334141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64c06-fd72-43a8-b909-d3140f9e5650 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:29.345679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0793a4-5467-4774-b500-074667e71e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:29.346572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0793a4-5467-4774-b500-074667e71e66 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:29.346711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0793a4-5467-4774-b500-074667e71e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:29.347007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0793a4-5467-4774-b500-074667e71e66 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:29.347741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0793a4-5467-4774-b500-074667e71e66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:29.349667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0793a4-5467-4774-b500-074667e71e66 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:29.375196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 374/736] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:30:29 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:30:29.469341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:29.481230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64c06-fd72-43a8-b909-d3140f9e5650 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:29.538989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d964f-898c-4f43-a172-9827094819cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:29.538989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d964f-898c-4f43-a172-9827094819cc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:29.538989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d964f-898c-4f43-a172-9827094819cc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:29.538989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d964f-898c-4f43-a172-9827094819cc None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:29.539433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d964f-898c-4f43-a172-9827094819cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:29.539433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d964f-898c-4f43-a172-9827094819cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:29.539433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d964f-898c-4f43-a172-9827094819cc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:29.544786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 363/737] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:29.551054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0793a4-5467-4774-b500-074667e71e66 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:29.663931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0793a4-5467-4774-b500-074667e71e66 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:29.679330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:29.683124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18b4c0-d9bc-4e52-b49e-b47e202c82bf None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:29.683597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18b4c0-d9bc-4e52-b49e-b47e202c82bf None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:29.683698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18b4c0-d9bc-4e52-b49e-b47e202c82bf None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:29.685777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 364/738] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:30:29.693124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048ed76-31b9-4b66-bfca-91261e7c6565 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:29.693852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048ed76-31b9-4b66-bfca-91261e7c6565 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:29.694226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048ed76-31b9-4b66-bfca-91261e7c6565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:29.707682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c20984-58ee-4a53-8054-d2d7035730cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:29.708561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c20984-58ee-4a53-8054-d2d7035730cf None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:29.708837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c20984-58ee-4a53-8054-d2d7035730cf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:29.709106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c20984-58ee-4a53-8054-d2d7035730cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:29.709816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c20984-58ee-4a53-8054-d2d7035730cf None admin] RBAC: Adding query filter params (interface=admin, service_id=579aa3238da34007b1744717cfd940ba, region_id=RegionOne) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:29.710124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c20984-58ee-4a53-8054-d2d7035730cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:29.711563 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c20984-58ee-4a53-8054-d2d7035730cf None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:29.715245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6048ed76-31b9-4b66-bfca-91261e7c6565 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:29.716443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6048ed76-31b9-4b66-bfca-91261e7c6565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:29.717292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 375/739] 10.222.0.46 () {56 vars in 1249 bytes} [Mon Oct 24 13:30:29 2022] GET /identity/v3/endpoints?service_id=579aa3238da34007b1744717cfd940ba&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:29.723395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c20984-58ee-4a53-8054-d2d7035730cf None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:29.810724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 365/740] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:29.846811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c20984-58ee-4a53-8054-d2d7035730cf None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:29.886179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d3798-bed2-430a-af37-a84d1bfcf2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:29.886807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d3798-bed2-430a-af37-a84d1bfcf2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:29.887112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d3798-bed2-430a-af37-a84d1bfcf2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:29.887373 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d3798-bed2-430a-af37-a84d1bfcf2d4 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:29.887998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d3798-bed2-430a-af37-a84d1bfcf2d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:29.889479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d3798-bed2-430a-af37-a84d1bfcf2d4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:29.897395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 376/741] 10.222.0.46 () {56 vars in 1087 bytes} [Mon Oct 24 13:30:29 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:30:30.022462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82341-ab74-4eb4-8ee7-d5f2dd9f7060 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:30.022943 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82341-ab74-4eb4-8ee7-d5f2dd9f7060 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:30.023347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82341-ab74-4eb4-8ee7-d5f2dd9f7060 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:30.025520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 366/742] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:30.031558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c7ce7-90bb-44fd-b039-b4fb3156b506 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:30.032033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c7ce7-90bb-44fd-b039-b4fb3156b506 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:30.032443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c7ce7-90bb-44fd-b039-b4fb3156b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:30.052578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c74c7ce7-90bb-44fd-b039-b4fb3156b506 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:30.053780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c74c7ce7-90bb-44fd-b039-b4fb3156b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:30.080997 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:30.100752 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e82341-ab74-4eb4-8ee7-d5f2dd9f7060 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:30.145294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 377/743] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:30.202900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:30.229485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e82341-ab74-4eb4-8ee7-d5f2dd9f7060 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:30.267691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea499a2-ba98-428f-8e70-5885c8e30c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:30.268323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea499a2-ba98-428f-8e70-5885c8e30c94 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:30.268596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea499a2-ba98-428f-8e70-5885c8e30c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:30.268865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea499a2-ba98-428f-8e70-5885c8e30c94 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:30.269530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea499a2-ba98-428f-8e70-5885c8e30c94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:30.271702 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea499a2-ba98-428f-8e70-5885c8e30c94 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:30.299151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 367/744] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:30:30 2022] POST /identity/v3/services => generated 242 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:30.441449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c7ce7-90bb-44fd-b039-b4fb3156b506 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:30.552611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c7ce7-90bb-44fd-b039-b4fb3156b506 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:30.593621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:30.594622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:30.595121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:30.595577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:30.596422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:30.598241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:30.601101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING keystone.server.flask.common [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 24 13:30:30.619884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.sql.core [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 13:30:30.619884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:30:30.619884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [parameters: {'id': '06f12a748526451cb485ae97490c3c74', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 13:30:30.619884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81763) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 06f12a748526451cb485ae97490c3c74.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 06f12a748526451cb485ae97490c3c74. Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:30:30.638160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 13:30:30.639162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application yield resource Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise self.value Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application session.commit() Oct 24 13:30:30.640185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:30:30.641086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:30:30.642009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:30:30.642807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [parameters: {'id': '06f12a748526451cb485ae97490c3c74', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:30.643708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:30.644492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:30.645538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:30.645538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 24 13:30:30.645538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 24 13:30:30.645538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:30.645538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:30.645538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 13:30:30.645538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 13:30:30.645538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 06f12a748526451cb485ae97490c3c74. Oct 24 13:30:30.645538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:30.649425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 378/745] 10.222.0.46 () {60 vars in 1140 bytes} [Mon Oct 24 13:30:30 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:30.657481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea499a2-ba98-428f-8e70-5885c8e30c94 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:30.763112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea499a2-ba98-428f-8e70-5885c8e30c94 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:30.798247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70527e55-01cc-42e8-8058-4af07d133141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:30.798892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527e55-01cc-42e8-8058-4af07d133141 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:30.799185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527e55-01cc-42e8-8058-4af07d133141 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:30.799455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527e55-01cc-42e8-8058-4af07d133141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:30.801531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:30.807169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70527e55-01cc-42e8-8058-4af07d133141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:30.808674 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70527e55-01cc-42e8-8058-4af07d133141 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-70527e55-01cc-42e8-8058-4af07d133141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:30.820805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:30.822792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:30.825279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:30.825279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:30.825279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:30.825279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:30.825279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:30.825279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:30.825279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:30.825279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:30.831077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 368/746] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:30.831181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:30.858099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:30.958625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499d2ed-61e2-4e56-9751-bc4320cf0c44 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:30.994583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f41f1e-8844-4ce4-911f-efd162415204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:30.995284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f41f1e-8844-4ce4-911f-efd162415204 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:30.995559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f41f1e-8844-4ce4-911f-efd162415204 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:30.995831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f41f1e-8844-4ce4-911f-efd162415204 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:30.996490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f41f1e-8844-4ce4-911f-efd162415204 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:30.996788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f41f1e-8844-4ce4-911f-efd162415204 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:30.998426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f41f1e-8844-4ce4-911f-efd162415204 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:31.019353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 379/747] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:31.792146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d673d8-c780-4669-8746-a584e49835fc None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:31.792705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d673d8-c780-4669-8746-a584e49835fc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:31.792705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d673d8-c780-4669-8746-a584e49835fc None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:31.795529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 369/748] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:31.805948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d4a3b-58e3-4c5c-b100-76b97cb0554f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:31.805948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d4a3b-58e3-4c5c-b100-76b97cb0554f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:31.805948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d4a3b-58e3-4c5c-b100-76b97cb0554f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:31.823765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4e0d4a3b-58e3-4c5c-b100-76b97cb0554f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:31.825507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4e0d4a3b-58e3-4c5c-b100-76b97cb0554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:31.900602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 380/749] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:32.203698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d673d8-c780-4669-8746-a584e49835fc None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:32.310822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd8b13-d9d8-4942-a74c-901bcda50951 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:32.311265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd8b13-d9d8-4942-a74c-901bcda50951 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:32.311436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd8b13-d9d8-4942-a74c-901bcda50951 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:32.313026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 381/750] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:32.319549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f495d-0571-4f8d-849f-8b14dcee8cf9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:32.319864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f495d-0571-4f8d-849f-8b14dcee8cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:32.320083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f495d-0571-4f8d-849f-8b14dcee8cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:32.329418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:32.339443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d673d8-c780-4669-8746-a584e49835fc None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:32.354004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-be1f495d-0571-4f8d-849f-8b14dcee8cf9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:32.357793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-be1f495d-0571-4f8d-849f-8b14dcee8cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:32.388351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded6d4-1466-4c66-82cb-7ea382419739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:32.388986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded6d4-1466-4c66-82cb-7ea382419739 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:32.389258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded6d4-1466-4c66-82cb-7ea382419739 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:32.389842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded6d4-1466-4c66-82cb-7ea382419739 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:32.390127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eded6d4-1466-4c66-82cb-7ea382419739 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:32.392078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eded6d4-1466-4c66-82cb-7ea382419739 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-6eded6d4-1466-4c66-82cb-7ea382419739 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:32.410081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:32.411186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:30:32.412032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:32.419450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 370/751] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:32.422944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded6d4-1466-4c66-82cb-7ea382419739 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:32.504554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:32.515209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 382/752] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:32 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:32.552004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded6d4-1466-4c66-82cb-7ea382419739 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:32.591114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ab53b-2f97-4020-93f8-275d1d433fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:32.591985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ab53b-2f97-4020-93f8-275d1d433fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:32.592500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ab53b-2f97-4020-93f8-275d1d433fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:32.592913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ab53b-2f97-4020-93f8-275d1d433fb3 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:32.593687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ab53b-2f97-4020-93f8-275d1d433fb3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:32.594144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ab53b-2f97-4020-93f8-275d1d433fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:32.595682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ab53b-2f97-4020-93f8-275d1d433fb3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:32.601996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 371/753] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:32.608450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f495d-0571-4f8d-849f-8b14dcee8cf9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:32.740564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4441d99-a66b-4def-8020-43d2bf187c21 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:32.740871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4441d99-a66b-4def-8020-43d2bf187c21 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:32.746945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4441d99-a66b-4def-8020-43d2bf187c21 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:32.748580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 372/754] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:32.749896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ee1e2-cb7c-400a-a66a-7644a30c6b25 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:32.753112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ee1e2-cb7c-400a-a66a-7644a30c6b25 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:32.753112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ee1e2-cb7c-400a-a66a-7644a30c6b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:32.753325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f495d-0571-4f8d-849f-8b14dcee8cf9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:32.786946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-206ee1e2-cb7c-400a-a66a-7644a30c6b25 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:32.786946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-206ee1e2-cb7c-400a-a66a-7644a30c6b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:32.814918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:32.820831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fb80c-7a60-4fb8-9415-9080a12b6f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:32.821455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fb80c-7a60-4fb8-9415-9080a12b6f40 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:32.821766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fb80c-7a60-4fb8-9415-9080a12b6f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:32.822038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fb80c-7a60-4fb8-9415-9080a12b6f40 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:32.826996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fb80c-7a60-4fb8-9415-9080a12b6f40 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:32.826996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fb80c-7a60-4fb8-9415-9080a12b6f40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:32.828349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fb80c-7a60-4fb8-9415-9080a12b6f40 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:32.835274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 383/755] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:32.846526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fb80c-7a60-4fb8-9415-9080a12b6f40 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:32.892723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 373/756] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:32 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:32.895839 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ee1e2-cb7c-400a-a66a-7644a30c6b25 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:32.987016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:33.015929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fb80c-7a60-4fb8-9415-9080a12b6f40 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:33.066464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39160f84-b7a9-4fe7-ab3d-5c93a6fabc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:33.070354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39160f84-b7a9-4fe7-ab3d-5c93a6fabc20 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.070354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39160f84-b7a9-4fe7-ab3d-5c93a6fabc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.070354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39160f84-b7a9-4fe7-ab3d-5c93a6fabc20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.070354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39160f84-b7a9-4fe7-ab3d-5c93a6fabc20 None admin] RBAC: Adding query filter params (interface=public, service_id=8da6b94b52834ad2ba17b33e4584203a, region_id=RegionOne) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:33.070354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39160f84-b7a9-4fe7-ab3d-5c93a6fabc20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:33.070354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39160f84-b7a9-4fe7-ab3d-5c93a6fabc20 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:33.080102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ee1e2-cb7c-400a-a66a-7644a30c6b25 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:33.080830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 384/757] 10.222.0.46 () {56 vars in 1251 bytes} [Mon Oct 24 13:30:32 2022] GET /identity/v3/endpoints?service_id=8da6b94b52834ad2ba17b33e4584203a&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:33.087833 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39160f84-b7a9-4fe7-ab3d-5c93a6fabc20 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:33.140199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70478-f3cd-444e-b26c-c874e0cc0bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:33.140850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70478-f3cd-444e-b26c-c874e0cc0bda None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.141128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70478-f3cd-444e-b26c-c874e0cc0bda None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.141399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70478-f3cd-444e-b26c-c874e0cc0bda None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.141993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c70478-f3cd-444e-b26c-c874e0cc0bda None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:33.143395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c70478-f3cd-444e-b26c-c874e0cc0bda None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-03c70478-f3cd-444e-b26c-c874e0cc0bda None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:33.158568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:33.159707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:30:33.160803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:33.167144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 374/758] 10.222.0.46 () {56 vars in 1126 bytes} [Mon Oct 24 13:30:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:33.169265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70478-f3cd-444e-b26c-c874e0cc0bda None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:33.172992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:33.227831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39160f84-b7a9-4fe7-ab3d-5c93a6fabc20 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:33.275882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4073d1-3f03-44a4-baab-b46083731f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:33.276658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4073d1-3f03-44a4-baab-b46083731f87 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.276769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4073d1-3f03-44a4-baab-b46083731f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.276978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4073d1-3f03-44a4-baab-b46083731f87 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.277576 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4073d1-3f03-44a4-baab-b46083731f87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:33.278972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4073d1-3f03-44a4-baab-b46083731f87 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:33.298977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 385/759] 10.222.0.46 () {56 vars in 1087 bytes} [Mon Oct 24 13:30:33 2022] GET /identity/v3/services => generated 1957 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:30:33.298977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4073d1-3f03-44a4-baab-b46083731f87 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:33.324072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70478-f3cd-444e-b26c-c874e0cc0bda None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:33.344887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:33.368915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c26a7-2e9f-4e58-8307-18daf992288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:33.369954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c26a7-2e9f-4e58-8307-18daf992288b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.370387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c26a7-2e9f-4e58-8307-18daf992288b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.370813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c26a7-2e9f-4e58-8307-18daf992288b None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.371794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c26a7-2e9f-4e58-8307-18daf992288b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:33.372351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c26a7-2e9f-4e58-8307-18daf992288b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:33.374014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c26a7-2e9f-4e58-8307-18daf992288b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:33.388445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 375/760] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:33.389510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c26a7-2e9f-4e58-8307-18daf992288b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:33.513879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4073d1-3f03-44a4-baab-b46083731f87 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:33.517327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c26a7-2e9f-4e58-8307-18daf992288b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:33.550879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:33.562541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5475c0-1097-4f2d-b252-c32051381716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:33.563308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5475c0-1097-4f2d-b252-c32051381716 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.563675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5475c0-1097-4f2d-b252-c32051381716 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.564022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5475c0-1097-4f2d-b252-c32051381716 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.564871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5475c0-1097-4f2d-b252-c32051381716 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:33.565182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5475c0-1097-4f2d-b252-c32051381716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:33.566909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5475c0-1097-4f2d-b252-c32051381716 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:33.567366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b983afb-d8d4-4408-b2cc-de0ab1eaa5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:33.567995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b983afb-d8d4-4408-b2cc-de0ab1eaa5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.568322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b983afb-d8d4-4408-b2cc-de0ab1eaa5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.568591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b983afb-d8d4-4408-b2cc-de0ab1eaa5c2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.570401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b983afb-d8d4-4408-b2cc-de0ab1eaa5c2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:33.571598 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b983afb-d8d4-4408-b2cc-de0ab1eaa5c2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:33.574905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 376/761] 10.222.0.46 () {56 vars in 1122 bytes} [Mon Oct 24 13:30:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:33.591085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5475c0-1097-4f2d-b252-c32051381716 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-3b983afb-d8d4-4408-b2cc-de0ab1eaa5c2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:33.593098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:33.594363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:30:33.595307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:33.598604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 386/762] 10.222.0.46 () {56 vars in 1105 bytes} [Mon Oct 24 13:30:33 2022] GET /identity/v3/services/image => generated 86 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:33.606469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b983afb-d8d4-4408-b2cc-de0ab1eaa5c2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:33.672755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:33.744593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5475c0-1097-4f2d-b252-c32051381716 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:33.760139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b983afb-d8d4-4408-b2cc-de0ab1eaa5c2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:33.783942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3dc7d-98b8-429c-90b3-02d223561a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:33.784947 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3dc7d-98b8-429c-90b3-02d223561a30 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.785479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3dc7d-98b8-429c-90b3-02d223561a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.786219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3dc7d-98b8-429c-90b3-02d223561a30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.787837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3dc7d-98b8-429c-90b3-02d223561a30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:33.789594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3dc7d-98b8-429c-90b3-02d223561a30 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:33.804907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71806f-296a-41b5-b1df-f1e1906c1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:33.805523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71806f-296a-41b5-b1df-f1e1906c1cbf None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.805865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71806f-296a-41b5-b1df-f1e1906c1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.806269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71806f-296a-41b5-b1df-f1e1906c1cbf None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.807044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71806f-296a-41b5-b1df-f1e1906c1cbf None admin] RBAC: Adding query filter params (name=image) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:33.807276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71806f-296a-41b5-b1df-f1e1906c1cbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:33.808891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71806f-296a-41b5-b1df-f1e1906c1cbf None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:33.823010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 387/763] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:33.823010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb1754-b350-4fe2-8094-8070edf3ff6a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.823010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb1754-b350-4fe2-8094-8070edf3ff6a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.823396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb1754-b350-4fe2-8094-8070edf3ff6a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.824007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 377/764] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:30:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:33.825336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3dc7d-98b8-429c-90b3-02d223561a30 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:33.831416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 388/765] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:33.833941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d52d8-b263-4908-84f2-f235f0f41159 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:33.834544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d52d8-b263-4908-84f2-f235f0f41159 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:33.835045 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d52d8-b263-4908-84f2-f235f0f41159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:33.857716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7b5d52d8-b263-4908-84f2-f235f0f41159 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:33.859467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7b5d52d8-b263-4908-84f2-f235f0f41159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:33.955568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:34.025408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 389/766] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:33 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:34.057564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3dc7d-98b8-429c-90b3-02d223561a30 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:34.061219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:34.109892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338eb99-34b8-4a5a-85ab-aaebe2aaac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:34.110102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338eb99-34b8-4a5a-85ab-aaebe2aaac48 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:34.110333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338eb99-34b8-4a5a-85ab-aaebe2aaac48 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:34.110569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338eb99-34b8-4a5a-85ab-aaebe2aaac48 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:34.111408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338eb99-34b8-4a5a-85ab-aaebe2aaac48 None admin] RBAC: Adding query filter params (type=image) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:34.111706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338eb99-34b8-4a5a-85ab-aaebe2aaac48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:34.113108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338eb99-34b8-4a5a-85ab-aaebe2aaac48 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:34.120854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 378/767] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:34.129413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d52d8-b263-4908-84f2-f235f0f41159 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:34.245498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d52d8-b263-4908-84f2-f235f0f41159 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:34.289534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2eb96-ea56-4bf7-b781-de4c586bc810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:34.289534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2eb96-ea56-4bf7-b781-de4c586bc810 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:34.289534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2eb96-ea56-4bf7-b781-de4c586bc810 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:34.289534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2eb96-ea56-4bf7-b781-de4c586bc810 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:34.289989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2eb96-ea56-4bf7-b781-de4c586bc810 None admin] RBAC: Adding query filter params (interface=public, service_id=69ae5a872fc84c91bb0cd55fd6b0e65a, region_id=RegionOne) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:34.289989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2eb96-ea56-4bf7-b781-de4c586bc810 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:34.290429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2eb96-ea56-4bf7-b781-de4c586bc810 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:34.297685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 390/768] 10.222.0.46 () {56 vars in 1251 bytes} [Mon Oct 24 13:30:34 2022] GET /identity/v3/endpoints?service_id=69ae5a872fc84c91bb0cd55fd6b0e65a&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:34.303966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338eb99-34b8-4a5a-85ab-aaebe2aaac48 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:34.304388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2eb96-ea56-4bf7-b781-de4c586bc810 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:34.377384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:34.478712 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338eb99-34b8-4a5a-85ab-aaebe2aaac48 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:34.497145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2eb96-ea56-4bf7-b781-de4c586bc810 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:34.531954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7f64-322a-4a59-a5c8-0bded08a9797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:34.534199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7f64-322a-4a59-a5c8-0bded08a9797 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:34.538610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7f64-322a-4a59-a5c8-0bded08a9797 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:34.539229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7f64-322a-4a59-a5c8-0bded08a9797 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:34.540077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac7f64-322a-4a59-a5c8-0bded08a9797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:34.541659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac7f64-322a-4a59-a5c8-0bded08a9797 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:34.541775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:34.542311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:34.542589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:34.542861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:34.543524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:34.545133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:34.553514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 379/769] 10.222.0.46 () {56 vars in 1087 bytes} [Mon Oct 24 13:30:34 2022] GET /identity/v3/services => generated 1957 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:30:34.580745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.sql.core [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 13:30:34.580745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 13:30:34.580745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [parameters: {'user_id': '1847d09437704959a506d96955db8d9f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 13:30:34.580745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81763) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Oct 24 13:30:34.593083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:30:34.594261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application yield resource Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise self.value Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application session.commit() Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:30:34.595302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:30:34.596223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:30:34.597123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:30:34.598064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [parameters: {'user_id': '1847d09437704959a506d96955db8d9f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:34.600536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 24 13:30:34.602482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 24 13:30:34.606559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 24 13:30:34.606559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 24 13:30:34.606559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:30:34.606559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:30:34.606559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 13:30:34.606559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:34.606559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 391/770] 10.222.0.46 () {60 vars in 1131 bytes} [Mon Oct 24 13:30:34 2022] POST /identity/v3/users => generated 160 bytes in 301 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:34.615017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7f64-322a-4a59-a5c8-0bded08a9797 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:34.665241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:34.745798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7f64-322a-4a59-a5c8-0bded08a9797 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:34.785473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73173461-f085-4901-a8ea-0564c3314aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:34.786122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173461-f085-4901-a8ea-0564c3314aaf None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:34.786402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173461-f085-4901-a8ea-0564c3314aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:34.786917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173461-f085-4901-a8ea-0564c3314aaf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:34.795829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73173461-f085-4901-a8ea-0564c3314aaf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:34.797435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73173461-f085-4901-a8ea-0564c3314aaf None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-73173461-f085-4901-a8ea-0564c3314aaf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:34.810539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:34.811700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:34.812684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 380/771] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:30:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:34.818592 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:34.947997 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81856301-7846-488f-b065-2fb0a67763ae None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:34.951061 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:34.986072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad94ea-ab66-4d01-841f-f6590ce95b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:34.986962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad94ea-ab66-4d01-841f-f6590ce95b61 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:34.987490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad94ea-ab66-4d01-841f-f6590ce95b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:34.987899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad94ea-ab66-4d01-841f-f6590ce95b61 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:34.988903 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad94ea-ab66-4d01-841f-f6590ce95b61 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:34.989585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad94ea-ab66-4d01-841f-f6590ce95b61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:34.991501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad94ea-ab66-4d01-841f-f6590ce95b61 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:35.033903 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 392/772] 10.222.0.46 () {56 vars in 1101 bytes} [Mon Oct 24 13:30:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:35.687790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225eb8-49f9-4743-9a8e-bd2a5bc72ac3 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:35.687790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225eb8-49f9-4743-9a8e-bd2a5bc72ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:35.687790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225eb8-49f9-4743-9a8e-bd2a5bc72ac3 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:35.689646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 381/773] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:35.695469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3acb5f-79ef-4e09-8395-5a2dac7e0a54 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:35.695746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3acb5f-79ef-4e09-8395-5a2dac7e0a54 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:35.696011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3acb5f-79ef-4e09-8395-5a2dac7e0a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:35.715393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2a3acb5f-79ef-4e09-8395-5a2dac7e0a54 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:35.716990 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2a3acb5f-79ef-4e09-8395-5a2dac7e0a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:35.798027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 393/774] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:35 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:36.071385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90225eb8-49f9-4743-9a8e-bd2a5bc72ac3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:36.174844 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:36.186959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90225eb8-49f9-4743-9a8e-bd2a5bc72ac3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:36.225213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1db7-8356-47b3-af0c-9dfccc5ee880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:36.225867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1db7-8356-47b3-af0c-9dfccc5ee880 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:36.226143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1db7-8356-47b3-af0c-9dfccc5ee880 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:36.226577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1db7-8356-47b3-af0c-9dfccc5ee880 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:36.227026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1db7-8356-47b3-af0c-9dfccc5ee880 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:36.228500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1db7-8356-47b3-af0c-9dfccc5ee880 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-bb9f1db7-8356-47b3-af0c-9dfccc5ee880 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:36.238275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:36.239332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:36.240667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 382/775] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:36.248506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3acb5f-79ef-4e09-8395-5a2dac7e0a54 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:36.321220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7add38-ff81-4210-a633-9e09f2a7ad83 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:36.321594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7add38-ff81-4210-a633-9e09f2a7ad83 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:36.321782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7add38-ff81-4210-a633-9e09f2a7ad83 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:36.324087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 383/776] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:30:36.330159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474318-9c94-415e-a0d5-b6cb63ba1846 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:36.330434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474318-9c94-415e-a0d5-b6cb63ba1846 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:36.330702 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474318-9c94-415e-a0d5-b6cb63ba1846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:36.355138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9e474318-9c94-415e-a0d5-b6cb63ba1846 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:36.356393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9e474318-9c94-415e-a0d5-b6cb63ba1846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:36.374342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:36.392715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3acb5f-79ef-4e09-8395-5a2dac7e0a54 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:36.444913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea1584-c4b3-48ab-9729-db008ca3027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:36.445584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1584-c4b3-48ab-9729-db008ca3027e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:36.445820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1584-c4b3-48ab-9729-db008ca3027e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:36.446091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1584-c4b3-48ab-9729-db008ca3027e None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:36.446759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea1584-c4b3-48ab-9729-db008ca3027e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:36.447170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea1584-c4b3-48ab-9729-db008ca3027e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:36.448524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea1584-c4b3-48ab-9729-db008ca3027e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:36.449242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 384/777] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:36 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:36.460101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 394/778] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:36.463283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474318-9c94-415e-a0d5-b6cb63ba1846 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:36.556485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:36.573886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474318-9c94-415e-a0d5-b6cb63ba1846 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:36.610849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717656b-3371-4ac3-a205-da412e28f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:36.611956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717656b-3371-4ac3-a205-da412e28f02c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:36.612422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717656b-3371-4ac3-a205-da412e28f02c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:36.612948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717656b-3371-4ac3-a205-da412e28f02c None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:36.613816 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717656b-3371-4ac3-a205-da412e28f02c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:36.614301 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717656b-3371-4ac3-a205-da412e28f02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:36.615892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717656b-3371-4ac3-a205-da412e28f02c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:36.621974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 385/779] 10.222.0.46 () {56 vars in 1112 bytes} [Mon Oct 24 13:30:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:36.630067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea1584-c4b3-48ab-9729-db008ca3027e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:36.725705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717656b-3371-4ac3-a205-da412e28f02c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:36.762137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea1584-c4b3-48ab-9729-db008ca3027e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:36.810312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a053b0e-0337-4b60-a487-0d742e0689aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:36.811671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053b0e-0337-4b60-a487-0d742e0689aa None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:36.812153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053b0e-0337-4b60-a487-0d742e0689aa None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:36.812636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053b0e-0337-4b60-a487-0d742e0689aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:36.813538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a053b0e-0337-4b60-a487-0d742e0689aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:36.816186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a053b0e-0337-4b60-a487-0d742e0689aa None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:36.843422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 395/780] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:30:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:36.861417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717656b-3371-4ac3-a205-da412e28f02c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:36.916800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2702aad-941d-4baa-b812-b36f217721a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:36.917723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702aad-941d-4baa-b812-b36f217721a7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:36.917846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702aad-941d-4baa-b812-b36f217721a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:36.918023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702aad-941d-4baa-b812-b36f217721a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:36.919304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2702aad-941d-4baa-b812-b36f217721a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:36.921371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2702aad-941d-4baa-b812-b36f217721a7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:36.923672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 386/781] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:36.929323 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56939d69-459f-40d1-8e65-83b91a22d349 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:36.929923 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56939d69-459f-40d1-8e65-83b91a22d349 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:36.930203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56939d69-459f-40d1-8e65-83b91a22d349 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:36.930646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2702aad-941d-4baa-b812-b36f217721a7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:36.931934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 396/782] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:36.937693 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f06438-877e-496c-86e0-07d4183aabc3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:36.938006 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f06438-877e-496c-86e0-07d4183aabc3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:36.938246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f06438-877e-496c-86e0-07d4183aabc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:36.950989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:36.959121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-58f06438-877e-496c-86e0-07d4183aabc3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:36.960360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-58f06438-877e-496c-86e0-07d4183aabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:36.973515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:37.054643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2702aad-941d-4baa-b812-b36f217721a7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:37.073340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 397/783] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:37.105957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac189-da42-45ef-958c-6c1fe6115f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:37.106500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac189-da42-45ef-958c-6c1fe6115f4a None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:37.106769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac189-da42-45ef-958c-6c1fe6115f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:37.107075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac189-da42-45ef-958c-6c1fe6115f4a None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:37.107729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ac189-da42-45ef-958c-6c1fe6115f4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:37.109301 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ac189-da42-45ef-958c-6c1fe6115f4a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:37.154991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 387/784] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:30:36 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:30:37.350698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f06438-877e-496c-86e0-07d4183aabc3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:37.482864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f06438-877e-496c-86e0-07d4183aabc3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:37.519650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef083e-b0e2-413b-92f8-34b90a5a566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:37.520290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef083e-b0e2-413b-92f8-34b90a5a566c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:37.520562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef083e-b0e2-413b-92f8-34b90a5a566c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:37.520826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef083e-b0e2-413b-92f8-34b90a5a566c None admin] PATH_INFO: `/v3/services/image` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:37.521398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef083e-b0e2-413b-92f8-34b90a5a566c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:37.522784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef083e-b0e2-413b-92f8-34b90a5a566c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-09ef083e-b0e2-413b-92f8-34b90a5a566c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:37.537555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:37.538684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:30:37.539901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:37.541184 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 398/785] 10.222.0.46 () {56 vars in 1105 bytes} [Mon Oct 24 13:30:37 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:37.547054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac189-da42-45ef-958c-6c1fe6115f4a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:37.619800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:37.658414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac189-da42-45ef-958c-6c1fe6115f4a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:37.701673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91729d21-b682-4c9a-abc1-53a7e5380c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:37.702715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91729d21-b682-4c9a-abc1-53a7e5380c0c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:37.703190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91729d21-b682-4c9a-abc1-53a7e5380c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:37.703598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91729d21-b682-4c9a-abc1-53a7e5380c0c None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:37.704385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91729d21-b682-4c9a-abc1-53a7e5380c0c None admin] RBAC: Adding query filter params (name=image) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:37.704861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91729d21-b682-4c9a-abc1-53a7e5380c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:37.706430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91729d21-b682-4c9a-abc1-53a7e5380c0c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:37.717238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 388/786] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:37.718276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef083e-b0e2-413b-92f8-34b90a5a566c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:37.733981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:37.841593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef083e-b0e2-413b-92f8-34b90a5a566c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:37.881220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6e93e-5a69-4cf2-9180-da06b8346702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:37.881841 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6e93e-5a69-4cf2-9180-da06b8346702 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:37.882118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6e93e-5a69-4cf2-9180-da06b8346702 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:37.882380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6e93e-5a69-4cf2-9180-da06b8346702 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:37.883063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6e93e-5a69-4cf2-9180-da06b8346702 None admin] RBAC: Adding query filter params (type=image) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:37.883359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6e93e-5a69-4cf2-9180-da06b8346702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:37.885221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6e93e-5a69-4cf2-9180-da06b8346702 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:37.895960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 399/787] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:37.897474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91729d21-b682-4c9a-abc1-53a7e5380c0c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:38.018072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91729d21-b682-4c9a-abc1-53a7e5380c0c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:38.051109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:38.059505 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e5b50-ce01-4c82-aa13-4534d75c56b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:38.060472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e5b50-ce01-4c82-aa13-4534d75c56b6 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:38.060966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e5b50-ce01-4c82-aa13-4534d75c56b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:38.061429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e5b50-ce01-4c82-aa13-4534d75c56b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:38.062300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e5b50-ce01-4c82-aa13-4534d75c56b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:38.063929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e5b50-ce01-4c82-aa13-4534d75c56b6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:38.087957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 389/788] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:30:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:39.266062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd730e3-0a25-4e91-a331-23139804c579 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:39.266062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd730e3-0a25-4e91-a331-23139804c579 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:39.266062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd730e3-0a25-4e91-a331-23139804c579 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:39.266062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 400/789] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:39.271845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ad64-93f2-43e3-ab3b-5f193b4f0884 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:39.272789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ad64-93f2-43e3-ab3b-5f193b4f0884 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:39.273272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ad64-93f2-43e3-ab3b-5f193b4f0884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:39.295159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0c03ad64-93f2-43e3-ab3b-5f193b4f0884 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:39.296354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0c03ad64-93f2-43e3-ab3b-5f193b4f0884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:39.386139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 390/790] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:39.470653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae5803-ae5b-452b-805f-6501c028be60 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:39.471329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae5803-ae5b-452b-805f-6501c028be60 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:39.471811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae5803-ae5b-452b-805f-6501c028be60 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:39.474970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 401/791] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:39.485215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444eabd7-a57d-4747-8f28-a59f9a27cf2f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:39.485215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444eabd7-a57d-4747-8f28-a59f9a27cf2f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:39.485215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444eabd7-a57d-4747-8f28-a59f9a27cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:39.504020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-444eabd7-a57d-4747-8f28-a59f9a27cf2f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:39.505535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-444eabd7-a57d-4747-8f28-a59f9a27cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:39.583092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 391/792] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:39.656451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae5803-ae5b-452b-805f-6501c028be60 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:39.736354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:39.773657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae5803-ae5b-452b-805f-6501c028be60 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:39.811005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a297cde-0b4e-4450-91d5-4657109de1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:39.812158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a297cde-0b4e-4450-91d5-4657109de1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:39.812664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a297cde-0b4e-4450-91d5-4657109de1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:39.813193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a297cde-0b4e-4450-91d5-4657109de1f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:39.825546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a297cde-0b4e-4450-91d5-4657109de1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-8a297cde-0b4e-4450-91d5-4657109de1f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:39.830765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:39.831782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:30:39.832681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:39.840584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 402/793] 10.222.0.46 () {56 vars in 1120 bytes} [Mon Oct 24 13:30:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:39.841449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444eabd7-a57d-4747-8f28-a59f9a27cf2f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:39.876752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a297cde-0b4e-4450-91d5-4657109de1f1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:39.904805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:39.976069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444eabd7-a57d-4747-8f28-a59f9a27cf2f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:39.998138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a297cde-0b4e-4450-91d5-4657109de1f1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:40.025143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8a92b-985b-4108-aa5f-30067e0be0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:40.026128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8a92b-985b-4108-aa5f-30067e0be0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.026540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8a92b-985b-4108-aa5f-30067e0be0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.027039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8a92b-985b-4108-aa5f-30067e0be0c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.028068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8a92b-985b-4108-aa5f-30067e0be0c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:40.028376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8a92b-985b-4108-aa5f-30067e0be0c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:40.029754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8a92b-985b-4108-aa5f-30067e0be0c1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:40.034471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:40.042435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 392/794] 10.222.0.46 () {56 vars in 1115 bytes} [Mon Oct 24 13:30:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:40.045267 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30a85-a4d5-4f5d-935c-99cff12dfe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:40.045904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30a85-a4d5-4f5d-935c-99cff12dfe74 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.046176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30a85-a4d5-4f5d-935c-99cff12dfe74 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.046441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30a85-a4d5-4f5d-935c-99cff12dfe74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.047656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad30a85-a4d5-4f5d-935c-99cff12dfe74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:40.049114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad30a85-a4d5-4f5d-935c-99cff12dfe74 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:40.050745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 403/795] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:40.052115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8a92b-985b-4108-aa5f-30067e0be0c1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:40.060764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30a85-a4d5-4f5d-935c-99cff12dfe74 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:40.177276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8a92b-985b-4108-aa5f-30067e0be0c1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:40.180241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30a85-a4d5-4f5d-935c-99cff12dfe74 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:40.180594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:40.219240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7e636-a281-4fec-a750-9ff14d568bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:40.219874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7e636-a281-4fec-a750-9ff14d568bce None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.220144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7e636-a281-4fec-a750-9ff14d568bce None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.220405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7e636-a281-4fec-a750-9ff14d568bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.223540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6e714-4fc1-4020-845e-a2c467d784b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:40.224853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6e714-4fc1-4020-845e-a2c467d784b7 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.225210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6e714-4fc1-4020-845e-a2c467d784b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.225551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6e714-4fc1-4020-845e-a2c467d784b7 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.226375 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6e714-4fc1-4020-845e-a2c467d784b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:40.228067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6e714-4fc1-4020-845e-a2c467d784b7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:40.235324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7e636-a281-4fec-a750-9ff14d568bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:40.236763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7e636-a281-4fec-a750-9ff14d568bce None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3fb7e636-a281-4fec-a750-9ff14d568bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:40.256306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:40.257370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:40.258263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:40.258263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:40.258263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:40.258443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 404/796] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:30:40 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:40.265407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6e714-4fc1-4020-845e-a2c467d784b7 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:40.267444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 393/797] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:40.337227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:40.392360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b23bc-9a4f-48ca-813e-545b48e57f51 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.392890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b23bc-9a4f-48ca-813e-545b48e57f51 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.392890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b23bc-9a4f-48ca-813e-545b48e57f51 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.394559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 394/798] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:40.400967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ea8fc-a82a-497f-aa9c-51d94f1c5525 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.401309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ea8fc-a82a-497f-aa9c-51d94f1c5525 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.401486 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ea8fc-a82a-497f-aa9c-51d94f1c5525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.405546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6e714-4fc1-4020-845e-a2c467d784b7 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:40.422734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6f5ea8fc-a82a-497f-aa9c-51d94f1c5525 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:40.423980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6f5ea8fc-a82a-497f-aa9c-51d94f1c5525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:40.446535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad5183-ad1a-4797-b3ec-5662c4adf453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:40.447167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5183-ad1a-4797-b3ec-5662c4adf453 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.447444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5183-ad1a-4797-b3ec-5662c4adf453 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.447710 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5183-ad1a-4797-b3ec-5662c4adf453 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.448365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad5183-ad1a-4797-b3ec-5662c4adf453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:40.448664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad5183-ad1a-4797-b3ec-5662c4adf453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:40.450079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad5183-ad1a-4797-b3ec-5662c4adf453 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:40.464461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 405/799] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:40.471914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad5183-ad1a-4797-b3ec-5662c4adf453 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:40.548952 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 395/800] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:40.620957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad5183-ad1a-4797-b3ec-5662c4adf453 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:40.635998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:40.658289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b03e01-4844-4868-ba16-6c9cd239b22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:40.659298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b03e01-4844-4868-ba16-6c9cd239b22d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.659885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b03e01-4844-4868-ba16-6c9cd239b22d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.660370 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b03e01-4844-4868-ba16-6c9cd239b22d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.668025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b03e01-4844-4868-ba16-6c9cd239b22d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:40.669742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b03e01-4844-4868-ba16-6c9cd239b22d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-92b03e01-4844-4868-ba16-6c9cd239b22d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:40.682043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:40.683062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:30:40.684027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:40.691173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 406/801] 10.222.0.46 () {56 vars in 1093 bytes} [Mon Oct 24 13:30:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:40.692355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ea8fc-a82a-497f-aa9c-51d94f1c5525 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:40.810986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b03e01-4844-4868-ba16-6c9cd239b22d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:40.921093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:40.937890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ea8fc-a82a-497f-aa9c-51d94f1c5525 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:40.943884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b03e01-4844-4868-ba16-6c9cd239b22d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:40.983142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e1fe4-196e-4f16-8e0d-adeabfd22f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:40.983759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e1fe4-196e-4f16-8e0d-adeabfd22f00 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.984032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e1fe4-196e-4f16-8e0d-adeabfd22f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.984296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e1fe4-196e-4f16-8e0d-adeabfd22f00 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.985024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e1fe4-196e-4f16-8e0d-adeabfd22f00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:40.985320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e1fe4-196e-4f16-8e0d-adeabfd22f00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:40.986753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e1fe4-196e-4f16-8e0d-adeabfd22f00 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:40.988149 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:40.989066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:40.989788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:40.990261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:40.991675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:40.993300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:41.006078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.sql.core [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:30:41.006078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:30:41.006078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [parameters: {'id': 'dfbed0268637467a8ff481a48fed5904', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 13:30:41.006078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81763) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:30:41.015781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 13:30:41.016706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application yield resource Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise self.value Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application session.commit() Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:30:41.017632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:30:41.018522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:30:41.020497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:30:41.021504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [parameters: {'id': 'dfbed0268637467a8ff481a48fed5904', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 13:30:41.024273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:41.026899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 407/802] 10.222.0.46 () {60 vars in 1137 bytes} [Mon Oct 24 13:30:40 2022] POST /identity/v3/domains => generated 190 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:41.029462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:41.035437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 396/803] 10.222.0.46 () {56 vars in 1133 bytes} [Mon Oct 24 13:30:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:41.039132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e1fe4-196e-4f16-8e0d-adeabfd22f00 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:41.086160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:41.160112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd23900-f9e5-4494-83db-4d87918fc5b1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:41.188412 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e1fe4-196e-4f16-8e0d-adeabfd22f00 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:41.202151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de94c3-d842-4b27-8565-54d939fed8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:41.202851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de94c3-d842-4b27-8565-54d939fed8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:41.203168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de94c3-d842-4b27-8565-54d939fed8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:41.203440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de94c3-d842-4b27-8565-54d939fed8c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:41.223453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de94c3-d842-4b27-8565-54d939fed8c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:41.225030 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de94c3-d842-4b27-8565-54d939fed8c3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:41.235213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f6191-7c72-4874-939a-ed7ab81cfb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:41.236229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f6191-7c72-4874-939a-ed7ab81cfb17 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:41.237199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f6191-7c72-4874-939a-ed7ab81cfb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:41.237543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f6191-7c72-4874-939a-ed7ab81cfb17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-18de94c3-d842-4b27-8565-54d939fed8c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:41.245441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:41.246439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:41.253369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:41.253369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:41.253369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:41.253369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 408/804] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:41.253716 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f6191-7c72-4874-939a-ed7ab81cfb17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:41.253716 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f6191-7c72-4874-939a-ed7ab81cfb17 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:41.254781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:41.260127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de94c3-d842-4b27-8565-54d939fed8c3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-915f6191-7c72-4874-939a-ed7ab81cfb17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:41.269429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:41.270736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:41.271672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:41.271672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:41.271672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:41.271672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 397/805] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:41.276587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f6191-7c72-4874-939a-ed7ab81cfb17 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:41.367652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:41.387235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de94c3-d842-4b27-8565-54d939fed8c3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:41.392271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f6191-7c72-4874-939a-ed7ab81cfb17 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:41.431069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dceea84-9b47-4f1b-a809-026f96c5e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:41.431973 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceea84-9b47-4f1b-a809-026f96c5e688 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:41.432244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceea84-9b47-4f1b-a809-026f96c5e688 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:41.432508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceea84-9b47-4f1b-a809-026f96c5e688 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:41.433145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dceea84-9b47-4f1b-a809-026f96c5e688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:41.433442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dceea84-9b47-4f1b-a809-026f96c5e688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:41.435029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dceea84-9b47-4f1b-a809-026f96c5e688 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:41.445778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cc8ff-3406-40c0-b9c3-d517fb00dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:41.446733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cc8ff-3406-40c0-b9c3-d517fb00dab2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:41.447256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cc8ff-3406-40c0-b9c3-d517fb00dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:41.447724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cc8ff-3406-40c0-b9c3-d517fb00dab2 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:41.448558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cc8ff-3406-40c0-b9c3-d517fb00dab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:41.449055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cc8ff-3406-40c0-b9c3-d517fb00dab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:41.450686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cc8ff-3406-40c0-b9c3-d517fb00dab2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:41.451109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 398/806] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:41.453443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dceea84-9b47-4f1b-a809-026f96c5e688 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:41.464573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 409/807] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:41.536394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:41.662221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dceea84-9b47-4f1b-a809-026f96c5e688 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:41.716566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc934566-97ba-4cef-9fe2-52d129f78677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:41.718415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934566-97ba-4cef-9fe2-52d129f78677 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:41.719222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934566-97ba-4cef-9fe2-52d129f78677 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:41.720047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934566-97ba-4cef-9fe2-52d129f78677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:41.730785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc934566-97ba-4cef-9fe2-52d129f78677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:41.732268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc934566-97ba-4cef-9fe2-52d129f78677 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-cc934566-97ba-4cef-9fe2-52d129f78677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:41.745023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:41.745957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:41.746848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:41.746848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:41.746848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:41.746848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:41.746848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:41.746848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:41.746848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:41.746848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:41.746848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 399/808] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:41.756557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cc8ff-3406-40c0-b9c3-d517fb00dab2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:41.890493 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cc8ff-3406-40c0-b9c3-d517fb00dab2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:41.924955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22435-675d-4002-8eb6-1ecc8cf07180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:41.925589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22435-675d-4002-8eb6-1ecc8cf07180 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:41.926033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22435-675d-4002-8eb6-1ecc8cf07180 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:41.926464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22435-675d-4002-8eb6-1ecc8cf07180 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:41.927178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22435-675d-4002-8eb6-1ecc8cf07180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:41.927478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22435-675d-4002-8eb6-1ecc8cf07180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:41.928910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22435-675d-4002-8eb6-1ecc8cf07180 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:41.945394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 410/809] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:30:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:41.946706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc934566-97ba-4cef-9fe2-52d129f78677 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:42.050734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc934566-97ba-4cef-9fe2-52d129f78677 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:42.067456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:42.085916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e8e8d-5378-41f1-b390-0e2dc441dfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:42.086906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e8e8d-5378-41f1-b390-0e2dc441dfb3 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:42.087202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e8e8d-5378-41f1-b390-0e2dc441dfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:42.087466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e8e8d-5378-41f1-b390-0e2dc441dfb3 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/3f5b069b5307470e96176481702d6e63/roles/d6bff0c559174ac1bd5c3f26fd124b23` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:42.089564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e8e8d-5378-41f1-b390-0e2dc441dfb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=3f5b069b5307470e96176481702d6e63, role_id=d6bff0c559174ac1bd5c3f26fd124b23)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:42.091296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e8e8d-5378-41f1-b390-0e2dc441dfb3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:42.106449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 400/810] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:30:41 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/3f5b069b5307470e96176481702d6e63/roles/d6bff0c559174ac1bd5c3f26fd124b23 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:30:42.535142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb48bbd-4228-476d-8653-19b82700bdca None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:42.535677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb48bbd-4228-476d-8653-19b82700bdca None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:42.535677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb48bbd-4228-476d-8653-19b82700bdca None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:42.537136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 411/811] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:42.542846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afe1be-6ec9-402a-a7ab-e022e3009d52 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:42.543326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afe1be-6ec9-402a-a7ab-e022e3009d52 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:42.543415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afe1be-6ec9-402a-a7ab-e022e3009d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:42.562333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-56afe1be-6ec9-402a-a7ab-e022e3009d52 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:42.563560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-56afe1be-6ec9-402a-a7ab-e022e3009d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:42.635427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 401/812] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:42.898390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb48bbd-4228-476d-8653-19b82700bdca None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:42.912196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:43.006334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb48bbd-4228-476d-8653-19b82700bdca None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:43.042251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fb9c4-526b-47fd-a66d-30fab23ad507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:43.042871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fb9c4-526b-47fd-a66d-30fab23ad507 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:43.043155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fb9c4-526b-47fd-a66d-30fab23ad507 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:43.043449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fb9c4-526b-47fd-a66d-30fab23ad507 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:43.054587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fb9c4-526b-47fd-a66d-30fab23ad507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-3a2fb9c4-526b-47fd-a66d-30fab23ad507 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:43.059392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:43.060334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:43.061174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 412/813] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:43.066959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afe1be-6ec9-402a-a7ab-e022e3009d52 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:43.172313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afe1be-6ec9-402a-a7ab-e022e3009d52 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:43.179660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:43.209210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650dafb-b83a-42ea-82a1-ac40c9d8677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:43.209810 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650dafb-b83a-42ea-82a1-ac40c9d8677f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:43.210081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650dafb-b83a-42ea-82a1-ac40c9d8677f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:43.210347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650dafb-b83a-42ea-82a1-ac40c9d8677f None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:43.211042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650dafb-b83a-42ea-82a1-ac40c9d8677f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:43.211313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650dafb-b83a-42ea-82a1-ac40c9d8677f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:43.212722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650dafb-b83a-42ea-82a1-ac40c9d8677f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:43.221250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 402/814] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:30:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:43.227374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fb9c4-526b-47fd-a66d-30fab23ad507 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:43.298339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:43.331060 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fb9c4-526b-47fd-a66d-30fab23ad507 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:43.367119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03949d98-0fc5-4e30-8512-26ce9ea3791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:43.367751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03949d98-0fc5-4e30-8512-26ce9ea3791b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:43.368029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03949d98-0fc5-4e30-8512-26ce9ea3791b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:43.368287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03949d98-0fc5-4e30-8512-26ce9ea3791b None admin] PATH_INFO: `/v3/users/7178314a68b84ec4a09495a65e45b8e0` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:43.386433 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03949d98-0fc5-4e30-8512-26ce9ea3791b None admin] RBAC: Authorizing `identity:get_user(user_id=7178314a68b84ec4a09495a65e45b8e0)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:43.388122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03949d98-0fc5-4e30-8512-26ce9ea3791b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:43.389971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 413/815] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:30:43 2022] GET /identity/v3/users/7178314a68b84ec4a09495a65e45b8e0 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:43.396107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650dafb-b83a-42ea-82a1-ac40c9d8677f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:43.508681 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650dafb-b83a-42ea-82a1-ac40c9d8677f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:43.543079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cd512-5118-4cbe-9096-21991ca2627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:43.543693 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cd512-5118-4cbe-9096-21991ca2627d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:43.543972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cd512-5118-4cbe-9096-21991ca2627d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:43.544243 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cd512-5118-4cbe-9096-21991ca2627d None admin] PATH_INFO: `/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:43.545362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cd512-5118-4cbe-9096-21991ca2627d None admin] RBAC: Authorizing `identity:get_project(project_id=7fc50f13b7084b11b2b085c0f117d6a5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:43.546905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cd512-5118-4cbe-9096-21991ca2627d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:43.548782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 403/816] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:30:43 2022] GET /identity/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:43.555103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03949d98-0fc5-4e30-8512-26ce9ea3791b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:43.663502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03949d98-0fc5-4e30-8512-26ce9ea3791b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:43.690627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:43.699620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6335550-294c-4b7d-978f-19b525b8f8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:43.700278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6335550-294c-4b7d-978f-19b525b8f8ca None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:43.700546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6335550-294c-4b7d-978f-19b525b8f8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:43.700810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6335550-294c-4b7d-978f-19b525b8f8ca None admin] PATH_INFO: `/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5/users/7178314a68b84ec4a09495a65e45b8e0/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:43.702699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6335550-294c-4b7d-978f-19b525b8f8ca None admin] RBAC: Authorizing `identity:create_grant(project_id=7fc50f13b7084b11b2b085c0f117d6a5, user_id=7178314a68b84ec4a09495a65e45b8e0, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:43.704157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6335550-294c-4b7d-978f-19b525b8f8ca None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:43.720266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 414/817] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:30:43 2022] PUT /identity/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5/users/7178314a68b84ec4a09495a65e45b8e0/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:30:44.282445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b8d1a-b766-4676-af25-9264dd6dec0b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:44.282674 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b8d1a-b766-4676-af25-9264dd6dec0b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:44.282967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b8d1a-b766-4676-af25-9264dd6dec0b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:44.284337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 404/818] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:44.289890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf77805-3583-4278-a798-9e70269e43aa None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:44.290172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf77805-3583-4278-a798-9e70269e43aa None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:44.290439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf77805-3583-4278-a798-9e70269e43aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:44.310972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7bf77805-3583-4278-a798-9e70269e43aa None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:44.312186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7bf77805-3583-4278-a798-9e70269e43aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:44.384541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 415/819] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:44.650424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b8d1a-b766-4676-af25-9264dd6dec0b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:44.688316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:44.755275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b8d1a-b766-4676-af25-9264dd6dec0b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:44.790513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea1e89-f918-45bd-832b-d2c7eda39046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:44.791172 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea1e89-f918-45bd-832b-d2c7eda39046 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:44.791431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea1e89-f918-45bd-832b-d2c7eda39046 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:44.791697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea1e89-f918-45bd-832b-d2c7eda39046 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:44.802171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea1e89-f918-45bd-832b-d2c7eda39046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-20ea1e89-f918-45bd-832b-d2c7eda39046 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:44.807032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:44.808034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:44.808928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 405/820] 10.222.0.46 () {56 vars in 1120 bytes} [Mon Oct 24 13:30:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:44.814349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf77805-3583-4278-a798-9e70269e43aa None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:44.918330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf77805-3583-4278-a798-9e70269e43aa None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:44.937474 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:44.956014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207246a-e861-4f79-ab68-a7eb0d0cd769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:44.956785 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207246a-e861-4f79-ab68-a7eb0d0cd769 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:44.957149 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207246a-e861-4f79-ab68-a7eb0d0cd769 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:44.957556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207246a-e861-4f79-ab68-a7eb0d0cd769 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:44.958224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207246a-e861-4f79-ab68-a7eb0d0cd769 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:44.958527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207246a-e861-4f79-ab68-a7eb0d0cd769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:44.959934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207246a-e861-4f79-ab68-a7eb0d0cd769 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:44.968280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 416/821] 10.222.0.46 () {56 vars in 1115 bytes} [Mon Oct 24 13:30:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:44.974551 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea1e89-f918-45bd-832b-d2c7eda39046 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:45.070491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:45.077785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea1e89-f918-45bd-832b-d2c7eda39046 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:45.112519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a3dc7-b3d2-4716-a514-d42704f1a71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:45.113192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3dc7-b3d2-4716-a514-d42704f1a71b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:45.113462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3dc7-b3d2-4716-a514-d42704f1a71b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:45.113720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3dc7-b3d2-4716-a514-d42704f1a71b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:45.124323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a3dc7-b3d2-4716-a514-d42704f1a71b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:45.126889 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a3dc7-b3d2-4716-a514-d42704f1a71b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-fa1a3dc7-b3d2-4716-a514-d42704f1a71b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:45.141750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:45.142883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:45.143815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:45.143815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:45.143815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:45.143815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 406/822] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:45.149128 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207246a-e861-4f79-ab68-a7eb0d0cd769 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:45.253180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207246a-e861-4f79-ab68-a7eb0d0cd769 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:45.290248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fadda-7eff-4622-b3d6-a2e8db4be7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:45.290864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fadda-7eff-4622-b3d6-a2e8db4be7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:45.291175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fadda-7eff-4622-b3d6-a2e8db4be7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:45.291442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fadda-7eff-4622-b3d6-a2e8db4be7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:45.292082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fadda-7eff-4622-b3d6-a2e8db4be7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:45.292386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fadda-7eff-4622-b3d6-a2e8db4be7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:45.293767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fadda-7eff-4622-b3d6-a2e8db4be7f8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:45.306166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 417/823] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:45.311965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a3dc7-b3d2-4716-a514-d42704f1a71b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:45.416176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a3dc7-b3d2-4716-a514-d42704f1a71b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:45.451338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb7ca-e6e6-424a-a8a1-5279d8d51d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:45.451970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb7ca-e6e6-424a-a8a1-5279d8d51d63 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:45.452243 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb7ca-e6e6-424a-a8a1-5279d8d51d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:45.452506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb7ca-e6e6-424a-a8a1-5279d8d51d63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:45.460700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fb7ca-e6e6-424a-a8a1-5279d8d51d63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:45.462123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fb7ca-e6e6-424a-a8a1-5279d8d51d63 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-ec9fb7ca-e6e6-424a-a8a1-5279d8d51d63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:30:45.473966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:45.475114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:30:45.476279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:45.479075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 407/824] 10.222.0.46 () {56 vars in 1093 bytes} [Mon Oct 24 13:30:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:45.480916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fadda-7eff-4622-b3d6-a2e8db4be7f8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:45.526568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:45.586664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fadda-7eff-4622-b3d6-a2e8db4be7f8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:45.622832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef7717-c432-46e4-80b5-890ea5408702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:45.623461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7717-c432-46e4-80b5-890ea5408702 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:45.623737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7717-c432-46e4-80b5-890ea5408702 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:45.624008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7717-c432-46e4-80b5-890ea5408702 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:45.624707 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef7717-c432-46e4-80b5-890ea5408702 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:45.625033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef7717-c432-46e4-80b5-890ea5408702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:45.626469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef7717-c432-46e4-80b5-890ea5408702 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:45.644016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 418/825] 10.222.0.46 () {56 vars in 1133 bytes} [Mon Oct 24 13:30:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:45.650180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb7ca-e6e6-424a-a8a1-5279d8d51d63 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:45.661772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:45.756024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb7ca-e6e6-424a-a8a1-5279d8d51d63 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:45.792678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5030-7d06-4d62-ad74-3a3d23b8258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:45.793290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5030-7d06-4d62-ad74-3a3d23b8258e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:45.793562 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5030-7d06-4d62-ad74-3a3d23b8258e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:45.793834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5030-7d06-4d62-ad74-3a3d23b8258e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:45.851879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f86c2-7084-47cf-bf6d-a5650da345fe None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:45.852429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f86c2-7084-47cf-bf6d-a5650da345fe None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:45.852429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f86c2-7084-47cf-bf6d-a5650da345fe None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:45.853909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 419/826] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:30:45.859080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecb7bc-1667-4a5c-b0d6-099f8813cec9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:45.859359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecb7bc-1667-4a5c-b0d6-099f8813cec9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:45.859649 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecb7bc-1667-4a5c-b0d6-099f8813cec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:45.863252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a5030-7d06-4d62-ad74-3a3d23b8258e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:45.864692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a5030-7d06-4d62-ad74-3a3d23b8258e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:45.874526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:45.878039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7aecb7bc-1667-4a5c-b0d6-099f8813cec9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:45.879305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7aecb7bc-1667-4a5c-b0d6-099f8813cec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:45.949027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 420/827] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:45.965654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 408/828] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:30:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:30:45.971445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecb7bc-1667-4a5c-b0d6-099f8813cec9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:45.999205 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:46.073352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecb7bc-1667-4a5c-b0d6-099f8813cec9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:46.215297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5030-7d06-4d62-ad74-3a3d23b8258e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:46.230158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad495332-2c2e-45ee-83a5-d4bea2db28a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:46.230830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad495332-2c2e-45ee-83a5-d4bea2db28a0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:46.231114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad495332-2c2e-45ee-83a5-d4bea2db28a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:46.231507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad495332-2c2e-45ee-83a5-d4bea2db28a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:46.242121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad495332-2c2e-45ee-83a5-d4bea2db28a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:46.243631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad495332-2c2e-45ee-83a5-d4bea2db28a0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ad495332-2c2e-45ee-83a5-d4bea2db28a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:30:46.258506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:46.259571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:30:46.260461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:30:46.260461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:30:46.260461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:46.260461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 421/829] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:46.265419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad495332-2c2e-45ee-83a5-d4bea2db28a0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:46.322705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5030-7d06-4d62-ad74-3a3d23b8258e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:46.332672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:46.346735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:46.357679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612a23-b6da-4da2-8033-98f775730d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:46.358298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612a23-b6da-4da2-8033-98f775730d85 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:46.358583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612a23-b6da-4da2-8033-98f775730d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:46.358846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612a23-b6da-4da2-8033-98f775730d85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:46.365674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad495332-2c2e-45ee-83a5-d4bea2db28a0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:46.369371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43612a23-b6da-4da2-8033-98f775730d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-43612a23-b6da-4da2-8033-98f775730d85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:30:46.374089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:46.375277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:30:46.376325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 409/830] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:30:46.383910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612a23-b6da-4da2-8033-98f775730d85 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:46.408582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a5e47-d4d0-4baf-9335-19c99c2fe5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:46.409187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5e47-d4d0-4baf-9335-19c99c2fe5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:46.409456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5e47-d4d0-4baf-9335-19c99c2fe5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:46.409778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5e47-d4d0-4baf-9335-19c99c2fe5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:46.410491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a5e47-d4d0-4baf-9335-19c99c2fe5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:46.410784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a5e47-d4d0-4baf-9335-19c99c2fe5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:46.412183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a5e47-d4d0-4baf-9335-19c99c2fe5f9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:46.423191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 422/831] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:46.429265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a5e47-d4d0-4baf-9335-19c99c2fe5f9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:46.485446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612a23-b6da-4da2-8033-98f775730d85 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:46.519808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38ad79-1e26-41c0-b354-960a09b4e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:46.520503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ad79-1e26-41c0-b354-960a09b4e8fd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:46.520779 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ad79-1e26-41c0-b354-960a09b4e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:46.521062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ad79-1e26-41c0-b354-960a09b4e8fd None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:46.521724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38ad79-1e26-41c0-b354-960a09b4e8fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:46.522020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38ad79-1e26-41c0-b354-960a09b4e8fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:46.523418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38ad79-1e26-41c0-b354-960a09b4e8fd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:46.526099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a5e47-d4d0-4baf-9335-19c99c2fe5f9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:46.531922 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 410/832] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:46.538382 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38ad79-1e26-41c0-b354-960a09b4e8fd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:46.559778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1f16a-85ec-4a51-b4be-6cc451726288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:46.560397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1f16a-85ec-4a51-b4be-6cc451726288 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:46.560669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1f16a-85ec-4a51-b4be-6cc451726288 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:46.560932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1f16a-85ec-4a51-b4be-6cc451726288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:46.567444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1f16a-85ec-4a51-b4be-6cc451726288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:46.568981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1f16a-85ec-4a51-b4be-6cc451726288 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:46.570996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:46.572286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-3ef1f16a-85ec-4a51-b4be-6cc451726288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:30:46.582881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:30:46.583947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:30:46.584859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:30:46.584859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:30:46.584859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:30:46.584859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:30:46.584859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:30:46.584859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:30:46.584859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:30:46.584859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:30:46.585970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 423/833] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:30:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:30:46.589832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1f16a-85ec-4a51-b4be-6cc451726288 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:46.646491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38ad79-1e26-41c0-b354-960a09b4e8fd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:46.680725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde2164-856e-4388-94ce-acc4de34cd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:46.681366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde2164-856e-4388-94ce-acc4de34cd08 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:46.681622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde2164-856e-4388-94ce-acc4de34cd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:46.681903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde2164-856e-4388-94ce-acc4de34cd08 None admin] PATH_INFO: `/v3/users/7178314a68b84ec4a09495a65e45b8e0` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:46.683044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde2164-856e-4388-94ce-acc4de34cd08 None admin] RBAC: Authorizing `identity:get_user(user_id=7178314a68b84ec4a09495a65e45b8e0)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:46.684482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde2164-856e-4388-94ce-acc4de34cd08 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:46.686062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 411/834] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:30:46 2022] GET /identity/v3/users/7178314a68b84ec4a09495a65e45b8e0 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:46.689270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1f16a-85ec-4a51-b4be-6cc451726288 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:46.692149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde2164-856e-4388-94ce-acc4de34cd08 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:46.722786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69362057-59c5-417e-9861-7ec60900e932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:46.723501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69362057-59c5-417e-9861-7ec60900e932 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:46.723774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69362057-59c5-417e-9861-7ec60900e932 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:46.724040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69362057-59c5-417e-9861-7ec60900e932 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:46.724724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69362057-59c5-417e-9861-7ec60900e932 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:46.725022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69362057-59c5-417e-9861-7ec60900e932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:46.726493 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69362057-59c5-417e-9861-7ec60900e932 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:46.739664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 424/835] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:30:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:46.745568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69362057-59c5-417e-9861-7ec60900e932 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:46.791072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:46.795496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde2164-856e-4388-94ce-acc4de34cd08 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:46.803875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:46.829499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e4d05-9c0f-42f8-84c0-ec36fbc27660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:46.830110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4d05-9c0f-42f8-84c0-ec36fbc27660 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:46.830384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4d05-9c0f-42f8-84c0-ec36fbc27660 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:46.830651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4d05-9c0f-42f8-84c0-ec36fbc27660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:46.847288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69362057-59c5-417e-9861-7ec60900e932 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:46.883221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c5371-e2a4-4166-b50e-03e85b39dd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:46.883875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c5371-e2a4-4166-b50e-03e85b39dd6a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:46.884064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c5371-e2a4-4166-b50e-03e85b39dd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:46.884331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c5371-e2a4-4166-b50e-03e85b39dd6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:46.885047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c5371-e2a4-4166-b50e-03e85b39dd6a None admin] RBAC: Adding query filter params (role.id=d6bff0c559174ac1bd5c3f26fd124b23, scope.project.id=11342796e85b428195cf5155b512162c, user.id=3f5b069b5307470e96176481702d6e63) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:46.885353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c5371-e2a4-4166-b50e-03e85b39dd6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:46.886795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c5371-e2a4-4166-b50e-03e85b39dd6a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:46.892682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 425/836] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:30:46 2022] GET /identity/v3/role_assignments?user.id=3f5b069b5307470e96176481702d6e63&scope.project.id=11342796e85b428195cf5155b512162c&role.id=d6bff0c559174ac1bd5c3f26fd124b23 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:30:46.902176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e4d05-9c0f-42f8-84c0-ec36fbc27660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:46.903699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e4d05-9c0f-42f8-84c0-ec36fbc27660 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:47.005552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:47.010374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 412/837] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:30:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 13:30:47.016697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c5371-e2a4-4166-b50e-03e85b39dd6a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:47.139110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c5371-e2a4-4166-b50e-03e85b39dd6a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:47.165283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:47.177035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd7a6d-2fa2-4978-87a2-00f4c4140b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:47.177683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd7a6d-2fa2-4978-87a2-00f4c4140b8f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:47.177947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd7a6d-2fa2-4978-87a2-00f4c4140b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:47.178216 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd7a6d-2fa2-4978-87a2-00f4c4140b8f None admin] PATH_INFO: `/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:47.179361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd7a6d-2fa2-4978-87a2-00f4c4140b8f None admin] RBAC: Authorizing `identity:get_project(project_id=7fc50f13b7084b11b2b085c0f117d6a5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:47.180771 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd7a6d-2fa2-4978-87a2-00f4c4140b8f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:47.182396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 426/838] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:30:47 2022] GET /identity/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:47.188735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e4d05-9c0f-42f8-84c0-ec36fbc27660 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:47.292165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e4d05-9c0f-42f8-84c0-ec36fbc27660 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:47.333639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dafbe7-3590-4b17-b9e0-e7d58db8ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:47.334374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dafbe7-3590-4b17-b9e0-e7d58db8ded3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:47.334711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dafbe7-3590-4b17-b9e0-e7d58db8ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:47.335092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dafbe7-3590-4b17-b9e0-e7d58db8ded3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:47.335808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dafbe7-3590-4b17-b9e0-e7d58db8ded3 None admin] RBAC: Adding query filter params (role.id=581091dd624142d3aad6710d1eb0affa, scope.project.id=7fc50f13b7084b11b2b085c0f117d6a5, user.id=7178314a68b84ec4a09495a65e45b8e0) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:47.336106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dafbe7-3590-4b17-b9e0-e7d58db8ded3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:47.337520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dafbe7-3590-4b17-b9e0-e7d58db8ded3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:47.344667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 413/839] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:30:47 2022] GET /identity/v3/role_assignments?user.id=7178314a68b84ec4a09495a65e45b8e0&scope.project.id=7fc50f13b7084b11b2b085c0f117d6a5&role.id=581091dd624142d3aad6710d1eb0affa => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:49.520899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227be4-434c-4edf-9faf-d84097b010a5 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:49.521458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227be4-434c-4edf-9faf-d84097b010a5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:49.521458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227be4-434c-4edf-9faf-d84097b010a5 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:49.522744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 427/840] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:49.528662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8989-8cd4-4858-8296-e30242b4a110 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:49.529118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8989-8cd4-4858-8296-e30242b4a110 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:49.529207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8989-8cd4-4858-8296-e30242b4a110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:49.547810 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-30ea8989-8cd4-4858-8296-e30242b4a110 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:49.548981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-30ea8989-8cd4-4858-8296-e30242b4a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:49.608249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:49.621246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 414/841] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:30:49.885292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53227be4-434c-4edf-9faf-d84097b010a5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:50.000274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53227be4-434c-4edf-9faf-d84097b010a5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:50.035680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb259-e84d-4363-9bbb-b81474356ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:50.036297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb259-e84d-4363-9bbb-b81474356ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:50.036564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb259-e84d-4363-9bbb-b81474356ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:50.036828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb259-e84d-4363-9bbb-b81474356ad3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:50.037951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb259-e84d-4363-9bbb-b81474356ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:50.039409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb259-e84d-4363-9bbb-b81474356ad3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:50.040973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 428/842] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:50.047074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8989-8cd4-4858-8296-e30242b4a110 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:50.154059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8989-8cd4-4858-8296-e30242b4a110 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:50.189603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f628bde-58b5-4d12-becc-4ce3e7016d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:50.190222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f628bde-58b5-4d12-becc-4ce3e7016d4e None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:50.190494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f628bde-58b5-4d12-becc-4ce3e7016d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:50.190806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f628bde-58b5-4d12-becc-4ce3e7016d4e None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:50.191554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f628bde-58b5-4d12-becc-4ce3e7016d4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:50.193094 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f628bde-58b5-4d12-becc-4ce3e7016d4e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:50.217033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 415/843] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:30:50 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:30:52.398902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8efff7-cf93-4bdb-9b8f-648628013580 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:52.399813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8efff7-cf93-4bdb-9b8f-648628013580 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:52.399813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8efff7-cf93-4bdb-9b8f-648628013580 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:52.401170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 429/844] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:52.407815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247455fa-9c4f-49be-b249-5c62505f8225 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:52.408584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247455fa-9c4f-49be-b249-5c62505f8225 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:52.408584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247455fa-9c4f-49be-b249-5c62505f8225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:52.427926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-247455fa-9c4f-49be-b249-5c62505f8225 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:52.429120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-247455fa-9c4f-49be-b249-5c62505f8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:52.484074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:52.512725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 416/845] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:52.789179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8efff7-cf93-4bdb-9b8f-648628013580 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:52.856298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:52.899962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8efff7-cf93-4bdb-9b8f-648628013580 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:52.934952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad6379-492d-4afc-8a14-2d91e6d0dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:52.935568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad6379-492d-4afc-8a14-2d91e6d0dedc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:52.935840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad6379-492d-4afc-8a14-2d91e6d0dedc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:52.936105 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad6379-492d-4afc-8a14-2d91e6d0dedc None admin] PATH_INFO: `/v3/roles/53001a60e154408cbe7ea6ad0f2d7e0f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:52.937536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad6379-492d-4afc-8a14-2d91e6d0dedc None admin] RBAC: Authorizing `identity:get_role(role_id=53001a60e154408cbe7ea6ad0f2d7e0f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:52.938909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad6379-492d-4afc-8a14-2d91e6d0dedc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:52.940276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 430/846] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:30:52 2022] GET /identity/v3/roles/53001a60e154408cbe7ea6ad0f2d7e0f => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:52.946391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247455fa-9c4f-49be-b249-5c62505f8225 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:53.060016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247455fa-9c4f-49be-b249-5c62505f8225 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:53.096226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899eb9-78d9-4045-a9fd-793047297ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:53.096922 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899eb9-78d9-4045-a9fd-793047297ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:53.097190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899eb9-78d9-4045-a9fd-793047297ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:53.097452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899eb9-78d9-4045-a9fd-793047297ad3 None admin] PATH_INFO: `/v3/users/3bdb6ff4e753496cbdde7fa479da284a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:53.111472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899eb9-78d9-4045-a9fd-793047297ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=3bdb6ff4e753496cbdde7fa479da284a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:53.112966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899eb9-78d9-4045-a9fd-793047297ad3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:53.114586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 417/847] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:30:52 2022] GET /identity/v3/users/3bdb6ff4e753496cbdde7fa479da284a => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:53.120721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad6379-492d-4afc-8a14-2d91e6d0dedc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:53.230379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad6379-492d-4afc-8a14-2d91e6d0dedc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:53.257554 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:53.265645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803578eb-cb00-4133-9e23-e89afd74bf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:53.266287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803578eb-cb00-4133-9e23-e89afd74bf66 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:53.266560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803578eb-cb00-4133-9e23-e89afd74bf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:53.266801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803578eb-cb00-4133-9e23-e89afd74bf66 None admin] PATH_INFO: `/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:53.267980 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803578eb-cb00-4133-9e23-e89afd74bf66 None admin] RBAC: Authorizing `identity:get_project(project_id=7fc50f13b7084b11b2b085c0f117d6a5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:53.269960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803578eb-cb00-4133-9e23-e89afd74bf66 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:53.272062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 431/848] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:30:53 2022] GET /identity/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:53.278546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899eb9-78d9-4045-a9fd-793047297ad3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:53.314347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:53.401203 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899eb9-78d9-4045-a9fd-793047297ad3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:53.437749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c45bb9-f552-4998-9687-ade525c5a009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:53.438455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c45bb9-f552-4998-9687-ade525c5a009 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:53.438654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c45bb9-f552-4998-9687-ade525c5a009 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:53.438952 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c45bb9-f552-4998-9687-ade525c5a009 None admin] PATH_INFO: `/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5/users/3bdb6ff4e753496cbdde7fa479da284a/roles/53001a60e154408cbe7ea6ad0f2d7e0f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:53.441691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c45bb9-f552-4998-9687-ade525c5a009 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fc50f13b7084b11b2b085c0f117d6a5, user_id=3bdb6ff4e753496cbdde7fa479da284a, role_id=53001a60e154408cbe7ea6ad0f2d7e0f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:53.443148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c45bb9-f552-4998-9687-ade525c5a009 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:53.461401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 418/849] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:30:53 2022] PUT /identity/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5/users/3bdb6ff4e753496cbdde7fa479da284a/roles/53001a60e154408cbe7ea6ad0f2d7e0f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:30:55.636941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260b53f-d7e1-4fec-93a2-b44df028c694 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:55.637463 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260b53f-d7e1-4fec-93a2-b44df028c694 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:55.637463 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260b53f-d7e1-4fec-93a2-b44df028c694 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:55.638672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 432/850] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:55.644697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a17b0-ba7f-4e45-bd7e-969ce43b28b7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:55.645117 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a17b0-ba7f-4e45-bd7e-969ce43b28b7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:55.645207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a17b0-ba7f-4e45-bd7e-969ce43b28b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:55.664800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-380a17b0-ba7f-4e45-bd7e-969ce43b28b7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:55.665994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-380a17b0-ba7f-4e45-bd7e-969ce43b28b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:55.736690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 419/851] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:56.011188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260b53f-d7e1-4fec-93a2-b44df028c694 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:56.126801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260b53f-d7e1-4fec-93a2-b44df028c694 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:56.164919 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102302-e112-45b7-bda8-022ab0e53781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:56.165545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102302-e112-45b7-bda8-022ab0e53781 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:56.165820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102302-e112-45b7-bda8-022ab0e53781 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:56.166086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102302-e112-45b7-bda8-022ab0e53781 None admin] PATH_INFO: `/v3/roles/53001a60e154408cbe7ea6ad0f2d7e0f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:56.167500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c102302-e112-45b7-bda8-022ab0e53781 None admin] RBAC: Authorizing `identity:get_role(role_id=53001a60e154408cbe7ea6ad0f2d7e0f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:56.168875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c102302-e112-45b7-bda8-022ab0e53781 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:56.170249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 433/852] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:30:56 2022] GET /identity/v3/roles/53001a60e154408cbe7ea6ad0f2d7e0f => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:56.177026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a17b0-ba7f-4e45-bd7e-969ce43b28b7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:56.205254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:56.286545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a17b0-ba7f-4e45-bd7e-969ce43b28b7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:56.320017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c726c-fdaf-4638-ae9e-158e2309fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:56.320650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c726c-fdaf-4638-ae9e-158e2309fd32 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:56.320943 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c726c-fdaf-4638-ae9e-158e2309fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:56.321112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c726c-fdaf-4638-ae9e-158e2309fd32 None admin] PATH_INFO: `/v3/users/3bdb6ff4e753496cbdde7fa479da284a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:56.322262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c726c-fdaf-4638-ae9e-158e2309fd32 None admin] RBAC: Authorizing `identity:get_user(user_id=3bdb6ff4e753496cbdde7fa479da284a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:56.323747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c726c-fdaf-4638-ae9e-158e2309fd32 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:56.325320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 420/853] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:30:56 2022] GET /identity/v3/users/3bdb6ff4e753496cbdde7fa479da284a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:56.331673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102302-e112-45b7-bda8-022ab0e53781 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:56.400131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:56.438526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102302-e112-45b7-bda8-022ab0e53781 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:56.475034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89868bb-0156-4941-af72-98c041aaa7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:56.475637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89868bb-0156-4941-af72-98c041aaa7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:56.475907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89868bb-0156-4941-af72-98c041aaa7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:56.476162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89868bb-0156-4941-af72-98c041aaa7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:56.575401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89868bb-0156-4941-af72-98c041aaa7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:56.576767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89868bb-0156-4941-af72-98c041aaa7f4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:56.640108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:56.681296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 434/854] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:30:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:30:56.687892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c726c-fdaf-4638-ae9e-158e2309fd32 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:56.790286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:56.798906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c726c-fdaf-4638-ae9e-158e2309fd32 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:56.836003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f955303-3f35-4dab-988a-44f82460f9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:56.836553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f955303-3f35-4dab-988a-44f82460f9cd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:56.836803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f955303-3f35-4dab-988a-44f82460f9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:56.837117 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f955303-3f35-4dab-988a-44f82460f9cd None admin] PATH_INFO: `/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:56.838207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f955303-3f35-4dab-988a-44f82460f9cd None admin] RBAC: Authorizing `identity:get_project(project_id=7fc50f13b7084b11b2b085c0f117d6a5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:56.839659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f955303-3f35-4dab-988a-44f82460f9cd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:56.841288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 421/855] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:30:56 2022] GET /identity/v3/projects/7fc50f13b7084b11b2b085c0f117d6a5 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:56.848138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89868bb-0156-4941-af72-98c041aaa7f4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:56.950587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89868bb-0156-4941-af72-98c041aaa7f4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:56.987730 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba5a02-29ba-4da9-8962-9954b9df4faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:56.988444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba5a02-29ba-4da9-8962-9954b9df4faf None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:56.988718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba5a02-29ba-4da9-8962-9954b9df4faf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:56.988981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba5a02-29ba-4da9-8962-9954b9df4faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:56.989684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba5a02-29ba-4da9-8962-9954b9df4faf None admin] RBAC: Adding query filter params (role.id=53001a60e154408cbe7ea6ad0f2d7e0f, scope.project.id=7fc50f13b7084b11b2b085c0f117d6a5, user.id=3bdb6ff4e753496cbdde7fa479da284a) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:30:56.989986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba5a02-29ba-4da9-8962-9954b9df4faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:56.991465 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba5a02-29ba-4da9-8962-9954b9df4faf None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:56.997814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 435/856] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:30:56 2022] GET /identity/v3/role_assignments?user.id=3bdb6ff4e753496cbdde7fa479da284a&scope.project.id=7fc50f13b7084b11b2b085c0f117d6a5&role.id=53001a60e154408cbe7ea6ad0f2d7e0f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:59.182608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f4a86-da10-423b-b075-d36f9c4eb7a0 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:59.183237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f4a86-da10-423b-b075-d36f9c4eb7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:59.183237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f4a86-da10-423b-b075-d36f9c4eb7a0 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:59.184489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 422/857] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:30:59.190676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274c4b7-9fae-4eb5-9575-9b0166674794 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:59.191450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274c4b7-9fae-4eb5-9575-9b0166674794 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:59.191778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274c4b7-9fae-4eb5-9575-9b0166674794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:59.222559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0274c4b7-9fae-4eb5-9575-9b0166674794 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:30:59.223868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0274c4b7-9fae-4eb5-9575-9b0166674794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:59.251239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:59.304800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 436/858] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:30:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:30:59.569863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f4a86-da10-423b-b075-d36f9c4eb7a0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:59.676904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f4a86-da10-423b-b075-d36f9c4eb7a0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:59.712764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8813995-1f7b-4184-819e-cadd83f252dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:59.713395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813995-1f7b-4184-819e-cadd83f252dd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:59.713667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813995-1f7b-4184-819e-cadd83f252dd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:59.713929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813995-1f7b-4184-819e-cadd83f252dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:59.715196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813995-1f7b-4184-819e-cadd83f252dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:59.716627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813995-1f7b-4184-819e-cadd83f252dd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:59.718194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 423/859] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:30:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:30:59.724710 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274c4b7-9fae-4eb5-9575-9b0166674794 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:59.826725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274c4b7-9fae-4eb5-9575-9b0166674794 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:59.861393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dccbc-bd07-4589-8648-030536727e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:59.861981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dccbc-bd07-4589-8648-030536727e74 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:59.862252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dccbc-bd07-4589-8648-030536727e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:59.862515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dccbc-bd07-4589-8648-030536727e74 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:59.863352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dccbc-bd07-4589-8648-030536727e74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:59.864778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dccbc-bd07-4589-8648-030536727e74 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:59.894104 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 437/860] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:30:59 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:31:02.089965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac578d-190f-493b-84c4-8a2fd720db20 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:02.090533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac578d-190f-493b-84c4-8a2fd720db20 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:02.090533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac578d-190f-493b-84c4-8a2fd720db20 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:02.091856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 424/861] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:31:02.097532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc0750-6d4f-48b6-82ca-4044b1278f2d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:02.097949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc0750-6d4f-48b6-82ca-4044b1278f2d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:02.098069 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc0750-6d4f-48b6-82ca-4044b1278f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:02.118154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4fbc0750-6d4f-48b6-82ca-4044b1278f2d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:31:02.119355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4fbc0750-6d4f-48b6-82ca-4044b1278f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:31:02.122716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:02.197796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 438/862] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:31:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:31:02.490821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac578d-190f-493b-84c4-8a2fd720db20 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:02.531487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:02.617727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac578d-190f-493b-84c4-8a2fd720db20 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:02.661440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7f01-84e0-441c-a853-0588422c5c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:02.662193 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7f01-84e0-441c-a853-0588422c5c42 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:02.662548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7f01-84e0-441c-a853-0588422c5c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:02.662940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7f01-84e0-441c-a853-0588422c5c42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:02.664498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7f01-84e0-441c-a853-0588422c5c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:02.666279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7f01-84e0-441c-a853-0588422c5c42 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:02.668104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 425/863] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:31:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:02.674814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc0750-6d4f-48b6-82ca-4044b1278f2d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:02.803094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc0750-6d4f-48b6-82ca-4044b1278f2d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:02.840040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75b76f-4c75-4ee5-8b6e-8f37a0dbc400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:02.840636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75b76f-4c75-4ee5-8b6e-8f37a0dbc400 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:02.840907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75b76f-4c75-4ee5-8b6e-8f37a0dbc400 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:02.841167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75b76f-4c75-4ee5-8b6e-8f37a0dbc400 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:02.841849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75b76f-4c75-4ee5-8b6e-8f37a0dbc400 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:02.843320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75b76f-4c75-4ee5-8b6e-8f37a0dbc400 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:02.855085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:02.867331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 439/864] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:31:02 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:31:05.014249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db08b40-c9ad-4938-96fc-8ef1420cf836 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:05.015223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db08b40-c9ad-4938-96fc-8ef1420cf836 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:05.015223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db08b40-c9ad-4938-96fc-8ef1420cf836 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:05.017221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 426/865] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:31:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:31:05.026134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335e1c9-785e-4a47-9c77-003eca450fcd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:05.026569 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335e1c9-785e-4a47-9c77-003eca450fcd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:05.026668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335e1c9-785e-4a47-9c77-003eca450fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:05.050194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5335e1c9-785e-4a47-9c77-003eca450fcd None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:31:05.051417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5335e1c9-785e-4a47-9c77-003eca450fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:31:05.123202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 440/866] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:31:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:31:05.389120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db08b40-c9ad-4938-96fc-8ef1420cf836 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:05.506248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:05.511931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db08b40-c9ad-4938-96fc-8ef1420cf836 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:05.548001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be118da-3501-45cd-aa69-25cf29b1066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:05.548621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be118da-3501-45cd-aa69-25cf29b1066a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:05.548895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be118da-3501-45cd-aa69-25cf29b1066a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:05.549162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be118da-3501-45cd-aa69-25cf29b1066a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:05.562311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be118da-3501-45cd-aa69-25cf29b1066a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3be118da-3501-45cd-aa69-25cf29b1066a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:31:05.570739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:31:05.572083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:31:05.573071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 427/867] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:31:05.578606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335e1c9-785e-4a47-9c77-003eca450fcd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:05.683045 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335e1c9-785e-4a47-9c77-003eca450fcd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:05.712324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:05.724051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257e2c-b5f2-4124-9854-19eb28cd5619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:05.724664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257e2c-b5f2-4124-9854-19eb28cd5619 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:05.724934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257e2c-b5f2-4124-9854-19eb28cd5619 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:05.725194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257e2c-b5f2-4124-9854-19eb28cd5619 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:05.725843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257e2c-b5f2-4124-9854-19eb28cd5619 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:31:05.726140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257e2c-b5f2-4124-9854-19eb28cd5619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:05.727553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257e2c-b5f2-4124-9854-19eb28cd5619 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:05.736789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 441/868] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:31:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:05.743754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be118da-3501-45cd-aa69-25cf29b1066a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:05.873391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be118da-3501-45cd-aa69-25cf29b1066a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:05.911846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b7412-a191-4da7-9de9-4fa14781b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:05.912514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7412-a191-4da7-9de9-4fa14781b27a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:05.912789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7412-a191-4da7-9de9-4fa14781b27a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:05.913085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7412-a191-4da7-9de9-4fa14781b27a None admin] PATH_INFO: `/v3/users/9cc180bffa4749548b3fcff230540eae` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:05.929638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b7412-a191-4da7-9de9-4fa14781b27a None admin] RBAC: Authorizing `identity:get_user(user_id=9cc180bffa4749548b3fcff230540eae)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:05.931121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b7412-a191-4da7-9de9-4fa14781b27a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:05.932740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 428/869] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:31:05 2022] GET /identity/v3/users/9cc180bffa4749548b3fcff230540eae => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:05.939689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257e2c-b5f2-4124-9854-19eb28cd5619 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:06.047519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257e2c-b5f2-4124-9854-19eb28cd5619 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:06.081837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f787b-81d9-4633-85ee-49ad7f626b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:06.082448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f787b-81d9-4633-85ee-49ad7f626b44 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:06.082719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f787b-81d9-4633-85ee-49ad7f626b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:06.082992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f787b-81d9-4633-85ee-49ad7f626b44 None admin] PATH_INFO: `/v3/projects/4e13999ba7b04c34b965b8085d78ac36` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:06.084121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f787b-81d9-4633-85ee-49ad7f626b44 None admin] RBAC: Authorizing `identity:get_project(project_id=4e13999ba7b04c34b965b8085d78ac36)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:06.085552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f787b-81d9-4633-85ee-49ad7f626b44 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:06.087191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 442/870] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:31:05 2022] GET /identity/v3/projects/4e13999ba7b04c34b965b8085d78ac36 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:06.094069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b7412-a191-4da7-9de9-4fa14781b27a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:06.119063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:06.205045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b7412-a191-4da7-9de9-4fa14781b27a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:06.250257 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4d833-65fc-4ab2-8d29-8f8a3e96f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:06.250906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4d833-65fc-4ab2-8d29-8f8a3e96f8af None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:06.251211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4d833-65fc-4ab2-8d29-8f8a3e96f8af None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:06.251475 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4d833-65fc-4ab2-8d29-8f8a3e96f8af None admin] PATH_INFO: `/v3/projects/4e13999ba7b04c34b965b8085d78ac36/users/9cc180bffa4749548b3fcff230540eae/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:06.253842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4d833-65fc-4ab2-8d29-8f8a3e96f8af None admin] RBAC: Authorizing `identity:create_grant(project_id=4e13999ba7b04c34b965b8085d78ac36, user_id=9cc180bffa4749548b3fcff230540eae, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:06.255328 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4d833-65fc-4ab2-8d29-8f8a3e96f8af None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:06.273663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 429/871] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:31:06 2022] PUT /identity/v3/projects/4e13999ba7b04c34b965b8085d78ac36/users/9cc180bffa4749548b3fcff230540eae/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:31:08.395533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2abed-90f9-4d83-afe9-980b8529881b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:08.396060 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2abed-90f9-4d83-afe9-980b8529881b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:08.396060 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2abed-90f9-4d83-afe9-980b8529881b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:08.397406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 443/872] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:31:08.403246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc42918-bce4-46e4-969e-36b3bab92d18 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:08.403684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc42918-bce4-46e4-969e-36b3bab92d18 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:08.403782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc42918-bce4-46e4-969e-36b3bab92d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:08.424179 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1cc42918-bce4-46e4-969e-36b3bab92d18 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:31:08.425464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1cc42918-bce4-46e4-969e-36b3bab92d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:31:08.497908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 430/873] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:31:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:31:08.766972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2abed-90f9-4d83-afe9-980b8529881b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:08.828774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:08.876268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2abed-90f9-4d83-afe9-980b8529881b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:08.912443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf323b-0a80-4262-bf9b-281d3b4af2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:08.913052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf323b-0a80-4262-bf9b-281d3b4af2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:08.913328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf323b-0a80-4262-bf9b-281d3b4af2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:08.913596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf323b-0a80-4262-bf9b-281d3b4af2f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:08.924675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf323b-0a80-4262-bf9b-281d3b4af2f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-36cf323b-0a80-4262-bf9b-281d3b4af2f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:31:08.929851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:31:08.930900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:31:08.931796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 444/874] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:31:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:31:08.939737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc42918-bce4-46e4-969e-36b3bab92d18 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:08.948452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:09.049708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc42918-bce4-46e4-969e-36b3bab92d18 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:09.087640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa42a6f-1ed7-403c-a3a2-923d94d82b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:09.088239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa42a6f-1ed7-403c-a3a2-923d94d82b9f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:09.088513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa42a6f-1ed7-403c-a3a2-923d94d82b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:09.088778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa42a6f-1ed7-403c-a3a2-923d94d82b9f None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:09.089439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa42a6f-1ed7-403c-a3a2-923d94d82b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:31:09.089741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa42a6f-1ed7-403c-a3a2-923d94d82b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:09.091129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa42a6f-1ed7-403c-a3a2-923d94d82b9f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:09.099258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 431/875] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:31:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:09.108801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf323b-0a80-4262-bf9b-281d3b4af2f1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:09.229214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf323b-0a80-4262-bf9b-281d3b4af2f1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:09.245247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:09.263962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659b436-859f-42ed-a7a5-05f958b6e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:09.264581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659b436-859f-42ed-a7a5-05f958b6e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:09.264855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659b436-859f-42ed-a7a5-05f958b6e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:09.265124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659b436-859f-42ed-a7a5-05f958b6e2c0 None admin] PATH_INFO: `/v3/users/9cc180bffa4749548b3fcff230540eae` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:09.266274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659b436-859f-42ed-a7a5-05f958b6e2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=9cc180bffa4749548b3fcff230540eae)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:09.267741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659b436-859f-42ed-a7a5-05f958b6e2c0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:09.269453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 445/876] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:31:09 2022] GET /identity/v3/users/9cc180bffa4749548b3fcff230540eae => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:09.276198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa42a6f-1ed7-403c-a3a2-923d94d82b9f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:09.348082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:09.391683 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa42a6f-1ed7-403c-a3a2-923d94d82b9f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:09.431555 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f708d6-7df8-4586-b8e3-01c621575672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:09.432480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f708d6-7df8-4586-b8e3-01c621575672 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:09.432904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f708d6-7df8-4586-b8e3-01c621575672 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:09.433336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f708d6-7df8-4586-b8e3-01c621575672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:09.517285 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f708d6-7df8-4586-b8e3-01c621575672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:09.518714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f708d6-7df8-4586-b8e3-01c621575672 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:09.584590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:09.622541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 432/877] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:31:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:31:09.628764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659b436-859f-42ed-a7a5-05f958b6e2c0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:09.750894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659b436-859f-42ed-a7a5-05f958b6e2c0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:09.786511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0759581-27d2-4659-b5d4-40dbaf92cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:09.787158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759581-27d2-4659-b5d4-40dbaf92cb09 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:09.787427 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759581-27d2-4659-b5d4-40dbaf92cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:09.787695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759581-27d2-4659-b5d4-40dbaf92cb09 None admin] PATH_INFO: `/v3/projects/4e13999ba7b04c34b965b8085d78ac36` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:09.788909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0759581-27d2-4659-b5d4-40dbaf92cb09 None admin] RBAC: Authorizing `identity:get_project(project_id=4e13999ba7b04c34b965b8085d78ac36)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:09.790341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0759581-27d2-4659-b5d4-40dbaf92cb09 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:09.792015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 446/878] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:31:09 2022] GET /identity/v3/projects/4e13999ba7b04c34b965b8085d78ac36 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:09.798538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f708d6-7df8-4586-b8e3-01c621575672 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:09.905130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f708d6-7df8-4586-b8e3-01c621575672 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:09.942041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a625e03-85cf-48ff-97e9-b63c5627a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:09.942630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a625e03-85cf-48ff-97e9-b63c5627a392 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:09.942897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a625e03-85cf-48ff-97e9-b63c5627a392 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:09.943191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a625e03-85cf-48ff-97e9-b63c5627a392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:09.943903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a625e03-85cf-48ff-97e9-b63c5627a392 None admin] RBAC: Adding query filter params (role.id=581091dd624142d3aad6710d1eb0affa, scope.project.id=4e13999ba7b04c34b965b8085d78ac36, user.id=9cc180bffa4749548b3fcff230540eae) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:31:09.944202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a625e03-85cf-48ff-97e9-b63c5627a392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:09.945609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a625e03-85cf-48ff-97e9-b63c5627a392 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:09.951362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 433/879] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:31:09 2022] GET /identity/v3/role_assignments?user.id=9cc180bffa4749548b3fcff230540eae&scope.project.id=4e13999ba7b04c34b965b8085d78ac36&role.id=581091dd624142d3aad6710d1eb0affa => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:12.152749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b6c3b-707e-4906-bab4-c23fc5cdbf68 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:12.153332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b6c3b-707e-4906-bab4-c23fc5cdbf68 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:12.153332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b6c3b-707e-4906-bab4-c23fc5cdbf68 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:12.154638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 447/880] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:31:12.161103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12359da-e311-4a28-aa31-67e5650ccd80 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:12.161856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12359da-e311-4a28-aa31-67e5650ccd80 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:12.161968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12359da-e311-4a28-aa31-67e5650ccd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:12.185671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c12359da-e311-4a28-aa31-67e5650ccd80 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:31:12.186859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c12359da-e311-4a28-aa31-67e5650ccd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:31:12.213582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:12.256313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 434/881] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:31:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:31:12.523013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b6c3b-707e-4906-bab4-c23fc5cdbf68 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:12.591053 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:12.641987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b6c3b-707e-4906-bab4-c23fc5cdbf68 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:12.677441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f376d3-61c0-4664-89c3-c7d02b4e53e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:12.678037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f376d3-61c0-4664-89c3-c7d02b4e53e0 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:12.678297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f376d3-61c0-4664-89c3-c7d02b4e53e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:12.678562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f376d3-61c0-4664-89c3-c7d02b4e53e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:12.679247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f376d3-61c0-4664-89c3-c7d02b4e53e0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:12.680615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f376d3-61c0-4664-89c3-c7d02b4e53e0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:12.699489 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 448/882] 10.222.0.46 () {60 vars in 1138 bytes} [Mon Oct 24 13:31:12 2022] POST /identity/v3/domains => generated 267 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:31:14.865513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193b75-d19c-4b61-a589-8d71cc093667 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:14.866074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193b75-d19c-4b61-a589-8d71cc093667 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:14.866074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193b75-d19c-4b61-a589-8d71cc093667 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:14.867440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 435/883] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:31:14.873808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807b243-6890-4de9-b66d-2272b124f81d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:14.874508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807b243-6890-4de9-b66d-2272b124f81d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:14.874663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807b243-6890-4de9-b66d-2272b124f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:14.897068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a807b243-6890-4de9-b66d-2272b124f81d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:31:14.898601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a807b243-6890-4de9-b66d-2272b124f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:31:14.973531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 449/884] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:31:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:31:15.249860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03193b75-d19c-4b61-a589-8d71cc093667 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:15.373164 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03193b75-d19c-4b61-a589-8d71cc093667 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:15.409145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd48632-1746-4145-a72f-736fe46f0946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:15.410084 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd48632-1746-4145-a72f-736fe46f0946 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:15.410361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd48632-1746-4145-a72f-736fe46f0946 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:15.410634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd48632-1746-4145-a72f-736fe46f0946 None admin] PATH_INFO: `/v3/domains/24f9af9f8cb841d29294a125445bd8fe` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:15.420831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd48632-1746-4145-a72f-736fe46f0946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24f9af9f8cb841d29294a125445bd8fe)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:15.422286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd48632-1746-4145-a72f-736fe46f0946 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:15.423912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 436/885] 10.222.0.46 () {56 vars in 1183 bytes} [Mon Oct 24 13:31:15 2022] GET /identity/v3/domains/24f9af9f8cb841d29294a125445bd8fe => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:15.430214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807b243-6890-4de9-b66d-2272b124f81d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:15.475714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:15.547663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807b243-6890-4de9-b66d-2272b124f81d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:15.583880 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aed47-3fb2-4ad0-9713-81f6cea94949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:15.584475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aed47-3fb2-4ad0-9713-81f6cea94949 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:15.584743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aed47-3fb2-4ad0-9713-81f6cea94949 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:15.585003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aed47-3fb2-4ad0-9713-81f6cea94949 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:15.585609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aed47-3fb2-4ad0-9713-81f6cea94949 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:15.587098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aed47-3fb2-4ad0-9713-81f6cea94949 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:15.617003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 450/886] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:31:15 2022] POST /identity/v3/projects => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:31:17.799007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e84e8-4b26-4edd-b12e-407cc3a0286c None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:17.799565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e84e8-4b26-4edd-b12e-407cc3a0286c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:17.799565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e84e8-4b26-4edd-b12e-407cc3a0286c None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:17.801634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 437/887] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:31:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:31:17.809859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f553f-f6df-442a-b7f9-2088c4ca8777 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:17.810322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f553f-f6df-442a-b7f9-2088c4ca8777 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:17.810425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f553f-f6df-442a-b7f9-2088c4ca8777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:17.830797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-cf5f553f-f6df-442a-b7f9-2088c4ca8777 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:31:17.832611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cf5f553f-f6df-442a-b7f9-2088c4ca8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:31:17.915204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 451/888] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:31:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:31:18.192919 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e84e8-4b26-4edd-b12e-407cc3a0286c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:18.226843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:18.314349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e84e8-4b26-4edd-b12e-407cc3a0286c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:18.352383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c0cd3-c46e-4d10-859e-a7911efad416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:18.352997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c0cd3-c46e-4d10-859e-a7911efad416 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:18.353273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c0cd3-c46e-4d10-859e-a7911efad416 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:18.353540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c0cd3-c46e-4d10-859e-a7911efad416 None admin] PATH_INFO: `/v3/domains/24f9af9f8cb841d29294a125445bd8fe` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:18.354698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c0cd3-c46e-4d10-859e-a7911efad416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24f9af9f8cb841d29294a125445bd8fe)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:18.356143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c0cd3-c46e-4d10-859e-a7911efad416 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:18.357706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 438/889] 10.222.0.46 () {56 vars in 1183 bytes} [Mon Oct 24 13:31:18 2022] GET /identity/v3/domains/24f9af9f8cb841d29294a125445bd8fe => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:18.365561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f553f-f6df-442a-b7f9-2088c4ca8777 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:18.392441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:18.469955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f553f-f6df-442a-b7f9-2088c4ca8777 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:18.509014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c6fe0-c6e0-49f7-a2c7-270f727ac95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:18.509603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c6fe0-c6e0-49f7-a2c7-270f727ac95b None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:18.509877 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c6fe0-c6e0-49f7-a2c7-270f727ac95b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:18.510138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c6fe0-c6e0-49f7-a2c7-270f727ac95b None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:18.510786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c6fe0-c6e0-49f7-a2c7-270f727ac95b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:18.512261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c6fe0-c6e0-49f7-a2c7-270f727ac95b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:18.538460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 452/890] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:31:18 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:31:20.699477 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8fbd7-94b8-4712-bd9f-bf434939d331 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:20.700337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8fbd7-94b8-4712-bd9f-bf434939d331 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:20.700337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8fbd7-94b8-4712-bd9f-bf434939d331 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:20.702307 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 439/891] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:31:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:31:20.708577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5246-ffcd-4118-af57-7281963ed8a1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:20.709031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5246-ffcd-4118-af57-7281963ed8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:20.709125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5246-ffcd-4118-af57-7281963ed8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:20.734168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-580a5246-ffcd-4118-af57-7281963ed8a1 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:31:20.735376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-580a5246-ffcd-4118-af57-7281963ed8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:31:20.808868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 453/892] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:31:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:31:21.083225 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8fbd7-94b8-4712-bd9f-bf434939d331 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:21.181908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:21.193880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8fbd7-94b8-4712-bd9f-bf434939d331 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:21.228568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a624f2-d0b3-47a4-9c40-c7715aa47efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:21.229199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a624f2-d0b3-47a4-9c40-c7715aa47efb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:21.229470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a624f2-d0b3-47a4-9c40-c7715aa47efb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:21.229734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a624f2-d0b3-47a4-9c40-c7715aa47efb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:21.239898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a624f2-d0b3-47a4-9c40-c7715aa47efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-34a624f2-d0b3-47a4-9c40-c7715aa47efb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:31:21.244690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:31:21.245605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:31:21.246451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 440/893] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:31:21.251961 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5246-ffcd-4118-af57-7281963ed8a1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:21.263778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:21.350461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5246-ffcd-4118-af57-7281963ed8a1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:21.386662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65f32c-fcc6-4609-97bc-2c96c01d8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:21.387461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65f32c-fcc6-4609-97bc-2c96c01d8920 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:21.387733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65f32c-fcc6-4609-97bc-2c96c01d8920 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:21.387993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65f32c-fcc6-4609-97bc-2c96c01d8920 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:21.388648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65f32c-fcc6-4609-97bc-2c96c01d8920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:31:21.388942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65f32c-fcc6-4609-97bc-2c96c01d8920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:21.390299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65f32c-fcc6-4609-97bc-2c96c01d8920 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:21.398842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 454/894] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:31:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:21.404890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a624f2-d0b3-47a4-9c40-c7715aa47efb None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:21.515476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a624f2-d0b3-47a4-9c40-c7715aa47efb None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:21.562991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6422a8a-d98e-4828-9cc7-1cfa8cd16966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:21.563878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6422a8a-d98e-4828-9cc7-1cfa8cd16966 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:21.564240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6422a8a-d98e-4828-9cc7-1cfa8cd16966 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:21.564576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6422a8a-d98e-4828-9cc7-1cfa8cd16966 None admin] PATH_INFO: `/v3/users/a50c1fde71314455b1917a92c1fbf599` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:21.579334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6422a8a-d98e-4828-9cc7-1cfa8cd16966 None admin] RBAC: Authorizing `identity:get_user(user_id=a50c1fde71314455b1917a92c1fbf599)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:21.580780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6422a8a-d98e-4828-9cc7-1cfa8cd16966 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:21.582709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 441/895] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:31:21 2022] GET /identity/v3/users/a50c1fde71314455b1917a92c1fbf599 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:21.588772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65f32c-fcc6-4609-97bc-2c96c01d8920 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:21.661569 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:21.707417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65f32c-fcc6-4609-97bc-2c96c01d8920 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:21.748531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add74f2-7a33-47d6-b926-533b5f421fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:21.749164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add74f2-7a33-47d6-b926-533b5f421fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:21.749409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add74f2-7a33-47d6-b926-533b5f421fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:21.749673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add74f2-7a33-47d6-b926-533b5f421fb4 None admin] PATH_INFO: `/v3/projects/a8824d2fa19e457897c3fab0789bb9b8` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:21.750850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add74f2-7a33-47d6-b926-533b5f421fb4 None admin] RBAC: Authorizing `identity:get_project(project_id=a8824d2fa19e457897c3fab0789bb9b8)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:21.752342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add74f2-7a33-47d6-b926-533b5f421fb4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:21.754115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 455/896] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:31:21 2022] GET /identity/v3/projects/a8824d2fa19e457897c3fab0789bb9b8 => generated 361 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:21.763383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6422a8a-d98e-4828-9cc7-1cfa8cd16966 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:21.778756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:21.882955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6422a8a-d98e-4828-9cc7-1cfa8cd16966 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:21.929220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba8486-890b-4a63-8923-9d03555f07e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:21.929803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba8486-890b-4a63-8923-9d03555f07e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:21.930074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba8486-890b-4a63-8923-9d03555f07e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:21.930337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba8486-890b-4a63-8923-9d03555f07e3 None admin] PATH_INFO: `/v3/projects/a8824d2fa19e457897c3fab0789bb9b8/users/a50c1fde71314455b1917a92c1fbf599/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:21.932744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba8486-890b-4a63-8923-9d03555f07e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8824d2fa19e457897c3fab0789bb9b8, user_id=a50c1fde71314455b1917a92c1fbf599, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:21.934001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba8486-890b-4a63-8923-9d03555f07e3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:21.952911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 442/897] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:31:21 2022] PUT /identity/v3/projects/a8824d2fa19e457897c3fab0789bb9b8/users/a50c1fde71314455b1917a92c1fbf599/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:31:24.203202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd181e-3205-42e2-b20a-fcee5dd4d73c None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:24.204145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd181e-3205-42e2-b20a-fcee5dd4d73c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:24.204145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd181e-3205-42e2-b20a-fcee5dd4d73c None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:24.206345 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 456/898] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:31:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:31:24.211679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2addd3e-bad5-4639-9db1-279a1c90dd1c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:24.212116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2addd3e-bad5-4639-9db1-279a1c90dd1c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:24.212213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2addd3e-bad5-4639-9db1-279a1c90dd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:24.231861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e2addd3e-bad5-4639-9db1-279a1c90dd1c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:31:24.233021 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e2addd3e-bad5-4639-9db1-279a1c90dd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:31:24.302106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:24.308254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 443/899] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:31:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:31:24.578139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd181e-3205-42e2-b20a-fcee5dd4d73c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:24.688610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd181e-3205-42e2-b20a-fcee5dd4d73c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:24.725533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb392fc-67d2-49cf-8d7e-6163050b6f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:24.726152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb392fc-67d2-49cf-8d7e-6163050b6f74 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:24.726430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb392fc-67d2-49cf-8d7e-6163050b6f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:24.726694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb392fc-67d2-49cf-8d7e-6163050b6f74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:24.734522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:24.738137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb392fc-67d2-49cf-8d7e-6163050b6f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-1bb392fc-67d2-49cf-8d7e-6163050b6f74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:31:24.743391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:31:24.744449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:31:24.745361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 457/900] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:31:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:31:24.750738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2addd3e-bad5-4639-9db1-279a1c90dd1c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:24.868617 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2addd3e-bad5-4639-9db1-279a1c90dd1c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:24.904476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea4a53-52b7-4d56-9713-9ba34a5afb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:24.905073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea4a53-52b7-4d56-9713-9ba34a5afb4a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:24.905341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea4a53-52b7-4d56-9713-9ba34a5afb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:24.905604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea4a53-52b7-4d56-9713-9ba34a5afb4a None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:24.906258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea4a53-52b7-4d56-9713-9ba34a5afb4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:31:24.906552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea4a53-52b7-4d56-9713-9ba34a5afb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:24.907935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea4a53-52b7-4d56-9713-9ba34a5afb4a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:24.916318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 444/901] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:31:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:24.923468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb392fc-67d2-49cf-8d7e-6163050b6f74 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:25.033090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb392fc-67d2-49cf-8d7e-6163050b6f74 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:25.068850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa235122-c810-4172-a936-afd35ca47d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:25.069458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa235122-c810-4172-a936-afd35ca47d99 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:25.069729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa235122-c810-4172-a936-afd35ca47d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:25.069990 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa235122-c810-4172-a936-afd35ca47d99 None admin] PATH_INFO: `/v3/users/a50c1fde71314455b1917a92c1fbf599` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:25.071148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa235122-c810-4172-a936-afd35ca47d99 None admin] RBAC: Authorizing `identity:get_user(user_id=a50c1fde71314455b1917a92c1fbf599)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:25.072608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa235122-c810-4172-a936-afd35ca47d99 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:25.074156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 458/902] 10.222.0.46 () {56 vars in 1177 bytes} [Mon Oct 24 13:31:24 2022] GET /identity/v3/users/a50c1fde71314455b1917a92c1fbf599 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:25.080294 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea4a53-52b7-4d56-9713-9ba34a5afb4a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:25.141831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:25.189962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea4a53-52b7-4d56-9713-9ba34a5afb4a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:25.226521 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f795-ba0f-461a-9aaa-b661d67541b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:25.227139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f795-ba0f-461a-9aaa-b661d67541b2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:25.227416 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f795-ba0f-461a-9aaa-b661d67541b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:25.227672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f795-ba0f-461a-9aaa-b661d67541b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:25.298774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f795-ba0f-461a-9aaa-b661d67541b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:25.300280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f795-ba0f-461a-9aaa-b661d67541b2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:25.355572 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:25.399208 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 445/903] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:31:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:31:25.405372 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa235122-c810-4172-a936-afd35ca47d99 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:25.486369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:25.524290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa235122-c810-4172-a936-afd35ca47d99 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:25.572221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0bb10-5e1c-4387-9b52-3a2cdf6c399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:25.572842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0bb10-5e1c-4387-9b52-3a2cdf6c399f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:25.573115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0bb10-5e1c-4387-9b52-3a2cdf6c399f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:25.573384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0bb10-5e1c-4387-9b52-3a2cdf6c399f None admin] PATH_INFO: `/v3/projects/a8824d2fa19e457897c3fab0789bb9b8` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:25.574631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0bb10-5e1c-4387-9b52-3a2cdf6c399f None admin] RBAC: Authorizing `identity:get_project(project_id=a8824d2fa19e457897c3fab0789bb9b8)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:25.576114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0bb10-5e1c-4387-9b52-3a2cdf6c399f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:25.577744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 459/904] 10.222.0.46 () {56 vars in 1186 bytes} [Mon Oct 24 13:31:25 2022] GET /identity/v3/projects/a8824d2fa19e457897c3fab0789bb9b8 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:25.585403 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f795-ba0f-461a-9aaa-b661d67541b2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:31:25.705685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f795-ba0f-461a-9aaa-b661d67541b2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:31:25.739911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acfd91-eca6-4269-a769-a27059bc0274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:31:25.740502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acfd91-eca6-4269-a769-a27059bc0274 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:31:25.740775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acfd91-eca6-4269-a769-a27059bc0274 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:31:25.741037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acfd91-eca6-4269-a769-a27059bc0274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:31:25.741754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acfd91-eca6-4269-a769-a27059bc0274 None admin] RBAC: Adding query filter params (role.id=581091dd624142d3aad6710d1eb0affa, scope.project.id=a8824d2fa19e457897c3fab0789bb9b8, user.id=a50c1fde71314455b1917a92c1fbf599) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:31:25.742063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acfd91-eca6-4269-a769-a27059bc0274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:31:25.743517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acfd91-eca6-4269-a769-a27059bc0274 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:31:25.749426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 446/905] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:31:25 2022] GET /identity/v3/role_assignments?user.id=a50c1fde71314455b1917a92c1fbf599&scope.project.id=a8824d2fa19e457897c3fab0789bb9b8&role.id=581091dd624142d3aad6710d1eb0affa => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:31:35.566358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=32 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:35.746671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:21.602110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c20ca-af1f-4942-b4d8-9040d0b77278 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:21.602110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c20ca-af1f-4942-b4d8-9040d0b77278 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:21.602110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c20ca-af1f-4942-b4d8-9040d0b77278 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:21.603180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 460/906] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:32:21.607993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948ff3-daa9-46a4-aeca-cd9385bac96f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:21.611948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948ff3-daa9-46a4-aeca-cd9385bac96f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:21.611948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948ff3-daa9-46a4-aeca-cd9385bac96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:21.634405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d8948ff3-daa9-46a4-aeca-cd9385bac96f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:32:21.635617 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d8948ff3-daa9-46a4-aeca-cd9385bac96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:32:21.726750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 447/907] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:32:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:32:22.021977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c20ca-af1f-4942-b4d8-9040d0b77278 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:22.160633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c20ca-af1f-4942-b4d8-9040d0b77278 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:22.206957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e93a3-07cd-4249-bfc8-8e849fc88fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:22.207668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e93a3-07cd-4249-bfc8-8e849fc88fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:22.207945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e93a3-07cd-4249-bfc8-8e849fc88fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:22.208212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e93a3-07cd-4249-bfc8-8e849fc88fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:22.220355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e93a3-07cd-4249-bfc8-8e849fc88fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:22.221836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e93a3-07cd-4249-bfc8-8e849fc88fb4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-cb0e93a3-07cd-4249-bfc8-8e849fc88fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:32:22.237041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:22.238087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:32:22.239476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:32:22.239476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:22.239476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:22.246669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 461/908] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:32:22.246831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948ff3-daa9-46a4-aeca-cd9385bac96f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:22.363033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948ff3-daa9-46a4-aeca-cd9385bac96f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:22.403048 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:22.409250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300735f-7e99-473f-be29-05ccc7d2176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:22.409978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300735f-7e99-473f-be29-05ccc7d2176f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:22.410481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300735f-7e99-473f-be29-05ccc7d2176f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:22.411070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300735f-7e99-473f-be29-05ccc7d2176f None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:22.412069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300735f-7e99-473f-be29-05ccc7d2176f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:22.412567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300735f-7e99-473f-be29-05ccc7d2176f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:22.414162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300735f-7e99-473f-be29-05ccc7d2176f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:22.428448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 448/909] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:22.434414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e93a3-07cd-4249-bfc8-8e849fc88fb4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:22.497622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:22.555086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e93a3-07cd-4249-bfc8-8e849fc88fb4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:22.594335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595172ff-3509-4ff9-9466-85aa7896a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:22.595025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595172ff-3509-4ff9-9466-85aa7896a6e7 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:22.595392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595172ff-3509-4ff9-9466-85aa7896a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:22.595723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595172ff-3509-4ff9-9466-85aa7896a6e7 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:22.596510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595172ff-3509-4ff9-9466-85aa7896a6e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:22.598128 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595172ff-3509-4ff9-9466-85aa7896a6e7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:22.635035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 462/910] 10.222.0.46 () {60 vars in 1132 bytes} [Mon Oct 24 13:32:22 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:32:24.919854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b7551-1286-45d2-9fda-fa6f1363fd11 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:24.920442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b7551-1286-45d2-9fda-fa6f1363fd11 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:24.920552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b7551-1286-45d2-9fda-fa6f1363fd11 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:24.922139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 449/911] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:32:24.928118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703ac6-8fde-4d8a-877a-ba4f571f55b9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:24.928736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703ac6-8fde-4d8a-877a-ba4f571f55b9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:24.928736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703ac6-8fde-4d8a-877a-ba4f571f55b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:24.949168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-65703ac6-8fde-4d8a-877a-ba4f571f55b9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:32:24.950347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-65703ac6-8fde-4d8a-877a-ba4f571f55b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:32:25.033692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 463/912] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:32:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:32:25.304336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b7551-1286-45d2-9fda-fa6f1363fd11 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:25.432721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b7551-1286-45d2-9fda-fa6f1363fd11 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:25.469665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653de10-263b-4171-8285-3427027d834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:25.470360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653de10-263b-4171-8285-3427027d834c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:25.470635 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653de10-263b-4171-8285-3427027d834c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:25.470986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653de10-263b-4171-8285-3427027d834c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:25.481493 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653de10-263b-4171-8285-3427027d834c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-8653de10-263b-4171-8285-3427027d834c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:32:25.486341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:25.487476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:25.488941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 450/913] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:32:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:25.493651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65703ac6-8fde-4d8a-877a-ba4f571f55b9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:25.538644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:25.606064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65703ac6-8fde-4d8a-877a-ba4f571f55b9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:25.644055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affec64-88a5-49d6-a5db-6102755208a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:25.644663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affec64-88a5-49d6-a5db-6102755208a4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:25.645267 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affec64-88a5-49d6-a5db-6102755208a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:25.645535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affec64-88a5-49d6-a5db-6102755208a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:25.646203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affec64-88a5-49d6-a5db-6102755208a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:25.646484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affec64-88a5-49d6-a5db-6102755208a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:25.647903 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affec64-88a5-49d6-a5db-6102755208a4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:25.656605 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 464/914] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:32:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:25.662753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653de10-263b-4171-8285-3427027d834c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:25.714873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:25.773795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653de10-263b-4171-8285-3427027d834c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:25.809740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09828456-651f-4493-a9bc-dd5c4589f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:25.810425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09828456-651f-4493-a9bc-dd5c4589f902 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:25.810741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09828456-651f-4493-a9bc-dd5c4589f902 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:25.810998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09828456-651f-4493-a9bc-dd5c4589f902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:25.821580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09828456-651f-4493-a9bc-dd5c4589f902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:25.823001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09828456-651f-4493-a9bc-dd5c4589f902 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-09828456-651f-4493-a9bc-dd5c4589f902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:32:25.842828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:25.844230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:32:25.845764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:32:25.845764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:25.845764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:25.847601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 451/915] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:32:25.853467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affec64-88a5-49d6-a5db-6102755208a4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:25.980240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:25.983919 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affec64-88a5-49d6-a5db-6102755208a4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:26.029763 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0d0ac-20c4-4189-94fb-f311e64df80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:26.030371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0d0ac-20c4-4189-94fb-f311e64df80c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:26.030646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0d0ac-20c4-4189-94fb-f311e64df80c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:26.030996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0d0ac-20c4-4189-94fb-f311e64df80c None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:26.031636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0d0ac-20c4-4189-94fb-f311e64df80c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:26.031928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0d0ac-20c4-4189-94fb-f311e64df80c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:26.033374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0d0ac-20c4-4189-94fb-f311e64df80c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:26.051226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 465/916] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:32:26.052592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09828456-651f-4493-a9bc-dd5c4589f902 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:26.165994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09828456-651f-4493-a9bc-dd5c4589f902 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:26.167721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:26.209163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a790-7e88-47ea-95ac-fc866caf572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:26.210010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a790-7e88-47ea-95ac-fc866caf572e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:26.210460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a790-7e88-47ea-95ac-fc866caf572e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:26.210612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a790-7e88-47ea-95ac-fc866caf572e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:26.219818 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a790-7e88-47ea-95ac-fc866caf572e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:26.221823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a790-7e88-47ea-95ac-fc866caf572e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-92b6a790-7e88-47ea-95ac-fc866caf572e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:32:26.234610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:26.235910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:32:26.237316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:26.238657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 452/917] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:26.244580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0d0ac-20c4-4189-94fb-f311e64df80c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:26.378731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0d0ac-20c4-4189-94fb-f311e64df80c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:26.425508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dc8a4-d47e-4dd0-bf19-487f5c8bd24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:26.426233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc8a4-d47e-4dd0-bf19-487f5c8bd24d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:26.426527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc8a4-d47e-4dd0-bf19-487f5c8bd24d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:26.426860 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc8a4-d47e-4dd0-bf19-487f5c8bd24d None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:26.427719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dc8a4-d47e-4dd0-bf19-487f5c8bd24d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:26.428064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dc8a4-d47e-4dd0-bf19-487f5c8bd24d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:26.429633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dc8a4-d47e-4dd0-bf19-487f5c8bd24d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:26.451516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 466/918] 10.222.0.46 () {56 vars in 1143 bytes} [Mon Oct 24 13:32:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:26.457919 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a790-7e88-47ea-95ac-fc866caf572e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:26.571871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a790-7e88-47ea-95ac-fc866caf572e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:26.614113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee02df-eb50-4c4a-928b-5e9b3f948213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:26.614799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee02df-eb50-4c4a-928b-5e9b3f948213 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:26.615144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee02df-eb50-4c4a-928b-5e9b3f948213 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:26.615402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee02df-eb50-4c4a-928b-5e9b3f948213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:26.633465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee02df-eb50-4c4a-928b-5e9b3f948213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:26.635200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee02df-eb50-4c4a-928b-5e9b3f948213 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d2ee02df-eb50-4c4a-928b-5e9b3f948213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:32:26.655431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:26.658468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:32:26.659593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:32:26.659593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:26.659593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:26.663663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 453/919] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:26.663800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dc8a4-d47e-4dd0-bf19-487f5c8bd24d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:26.684647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:26.773812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dc8a4-d47e-4dd0-bf19-487f5c8bd24d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:26.809911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bab2f-6fed-4d7e-9475-f9ca90613232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:26.810585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bab2f-6fed-4d7e-9475-f9ca90613232 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:26.810863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bab2f-6fed-4d7e-9475-f9ca90613232 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:26.811160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bab2f-6fed-4d7e-9475-f9ca90613232 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:26.811798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bab2f-6fed-4d7e-9475-f9ca90613232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:26.812094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bab2f-6fed-4d7e-9475-f9ca90613232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:26.813493 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bab2f-6fed-4d7e-9475-f9ca90613232 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:26.826186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 467/920] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:32:26.832569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee02df-eb50-4c4a-928b-5e9b3f948213 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:26.850089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:26.967196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee02df-eb50-4c4a-928b-5e9b3f948213 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:27.008781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542ad63-3e5f-4f1e-9ef8-56e8659fc0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:27.009426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ad63-3e5f-4f1e-9ef8-56e8659fc0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:27.009699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ad63-3e5f-4f1e-9ef8-56e8659fc0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:27.009967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ad63-3e5f-4f1e-9ef8-56e8659fc0d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:27.017005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542ad63-3e5f-4f1e-9ef8-56e8659fc0d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:27.018488 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542ad63-3e5f-4f1e-9ef8-56e8659fc0d7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d542ad63-3e5f-4f1e-9ef8-56e8659fc0d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:32:27.030647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:27.037142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:27.038101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:32:27.038101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:32:27.038101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:32:27.038101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:32:27.038101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:32:27.038101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:32:27.038101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:32:27.038101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:27.038101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 454/921] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:27.040354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bab2f-6fed-4d7e-9475-f9ca90613232 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:27.132936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:27.158263 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bab2f-6fed-4d7e-9475-f9ca90613232 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:27.197174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c0cd1-3877-4640-b4fc-4d1d981abc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:27.197782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c0cd1-3877-4640-b4fc-4d1d981abc50 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:27.198054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c0cd1-3877-4640-b4fc-4d1d981abc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:27.198318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c0cd1-3877-4640-b4fc-4d1d981abc50 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:27.199031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c0cd1-3877-4640-b4fc-4d1d981abc50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:27.199329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c0cd1-3877-4640-b4fc-4d1d981abc50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:27.200762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c0cd1-3877-4640-b4fc-4d1d981abc50 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:27.214477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 468/922] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:32:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:32:27.221112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542ad63-3e5f-4f1e-9ef8-56e8659fc0d7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:27.301845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:27.329816 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542ad63-3e5f-4f1e-9ef8-56e8659fc0d7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:27.368897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f0cb7-6ee8-434c-9836-f34ee0d5c432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:27.369180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f0cb7-6ee8-434c-9836-f34ee0d5c432 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:27.369288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f0cb7-6ee8-434c-9836-f34ee0d5c432 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:27.369523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f0cb7-6ee8-434c-9836-f34ee0d5c432 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/0f040c31c0d4439594404739d44a5435/roles/69a1febe83c9483cb6175c815d7e4f8e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:27.387695 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f0cb7-6ee8-434c-9836-f34ee0d5c432 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=0f040c31c0d4439594404739d44a5435, role_id=69a1febe83c9483cb6175c815d7e4f8e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:27.389199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f0cb7-6ee8-434c-9836-f34ee0d5c432 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:27.406116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 455/923] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:32:27 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/0f040c31c0d4439594404739d44a5435/roles/69a1febe83c9483cb6175c815d7e4f8e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:32:29.648418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd698c-79c1-4560-b73a-976002ca83cd None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:29.648938 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd698c-79c1-4560-b73a-976002ca83cd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:29.648938 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd698c-79c1-4560-b73a-976002ca83cd None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:29.650236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 469/924] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:32:29.657006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ea86e-2be5-4962-b890-76c7d14523f7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:29.657619 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ea86e-2be5-4962-b890-76c7d14523f7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:29.657619 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ea86e-2be5-4962-b890-76c7d14523f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:29.681127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f15ea86e-2be5-4962-b890-76c7d14523f7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:32:29.683068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f15ea86e-2be5-4962-b890-76c7d14523f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:32:29.770968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 456/925] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:32:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:32:30.077556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd698c-79c1-4560-b73a-976002ca83cd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:30.206403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd698c-79c1-4560-b73a-976002ca83cd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:30.239997 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6d511-ef28-4231-b98b-dc01f849c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:30.240634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6d511-ef28-4231-b98b-dc01f849c850 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:30.240935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6d511-ef28-4231-b98b-dc01f849c850 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:30.241247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6d511-ef28-4231-b98b-dc01f849c850 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:30.248650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:30.253452 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6d511-ef28-4231-b98b-dc01f849c850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-63b6d511-ef28-4231-b98b-dc01f849c850 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:32:30.261131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:30.262288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:30.263210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 470/926] 10.222.0.46 () {56 vars in 1102 bytes} [Mon Oct 24 13:32:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:30.269289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ea86e-2be5-4962-b890-76c7d14523f7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:30.328719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:30.376335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ea86e-2be5-4962-b890-76c7d14523f7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:30.412854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1db38-7f61-41bc-930b-1a3024e0bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:30.413462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1db38-7f61-41bc-930b-1a3024e0bbcd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:30.413735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1db38-7f61-41bc-930b-1a3024e0bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:30.414001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1db38-7f61-41bc-930b-1a3024e0bbcd None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:30.414661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1db38-7f61-41bc-930b-1a3024e0bbcd None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:30.414988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1db38-7f61-41bc-930b-1a3024e0bbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:30.416360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1db38-7f61-41bc-930b-1a3024e0bbcd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:30.425044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 457/927] 10.222.0.46 () {56 vars in 1103 bytes} [Mon Oct 24 13:32:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:30.431619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6d511-ef28-4231-b98b-dc01f849c850 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:30.538554 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6d511-ef28-4231-b98b-dc01f849c850 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:30.573511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d38cdb-fec4-4fa4-81da-2c8a53fe7952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:30.574243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d38cdb-fec4-4fa4-81da-2c8a53fe7952 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:30.574542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d38cdb-fec4-4fa4-81da-2c8a53fe7952 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:30.574862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d38cdb-fec4-4fa4-81da-2c8a53fe7952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:30.585886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d38cdb-fec4-4fa4-81da-2c8a53fe7952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:30.587394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d38cdb-fec4-4fa4-81da-2c8a53fe7952 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-58d38cdb-fec4-4fa4-81da-2c8a53fe7952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:32:30.603441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:30.604461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:32:30.605383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:32:30.605383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:30.605383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:30.605383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 471/928] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:30.611197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1db38-7f61-41bc-930b-1a3024e0bbcd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:30.713523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1db38-7f61-41bc-930b-1a3024e0bbcd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:30.730337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:30.748464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9466b0-9506-45e0-bc97-a372f6f0fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:30.749153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9466b0-9506-45e0-bc97-a372f6f0fa2a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:30.749444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9466b0-9506-45e0-bc97-a372f6f0fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:30.749650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9466b0-9506-45e0-bc97-a372f6f0fa2a None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:30.750341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9466b0-9506-45e0-bc97-a372f6f0fa2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:30.750637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9466b0-9506-45e0-bc97-a372f6f0fa2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:30.752280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9466b0-9506-45e0-bc97-a372f6f0fa2a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:30.764351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 458/929] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:30.770941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d38cdb-fec4-4fa4-81da-2c8a53fe7952 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:30.823966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:30.885510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d38cdb-fec4-4fa4-81da-2c8a53fe7952 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:30.926531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77733d-3ab3-4a8b-a46a-7647f66bfd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:30.927226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77733d-3ab3-4a8b-a46a-7647f66bfd76 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:30.927630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77733d-3ab3-4a8b-a46a-7647f66bfd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:30.927936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77733d-3ab3-4a8b-a46a-7647f66bfd76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:30.936257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77733d-3ab3-4a8b-a46a-7647f66bfd76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:30.937686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77733d-3ab3-4a8b-a46a-7647f66bfd76 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-be77733d-3ab3-4a8b-a46a-7647f66bfd76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:32:30.949287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:30.950528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:30.951643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 472/930] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:30.956624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9466b0-9506-45e0-bc97-a372f6f0fa2a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:31.067354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9466b0-9506-45e0-bc97-a372f6f0fa2a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:31.105406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36bd3c-ca2f-4c4c-9949-9c348c560aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:31.106207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36bd3c-ca2f-4c4c-9949-9c348c560aca None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:31.106546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36bd3c-ca2f-4c4c-9949-9c348c560aca None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:31.106746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36bd3c-ca2f-4c4c-9949-9c348c560aca None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:31.107568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36bd3c-ca2f-4c4c-9949-9c348c560aca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:31.107808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36bd3c-ca2f-4c4c-9949-9c348c560aca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:31.109550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36bd3c-ca2f-4c4c-9949-9c348c560aca None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:31.128107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 459/931] 10.222.0.46 () {56 vars in 1143 bytes} [Mon Oct 24 13:32:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:31.134374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77733d-3ab3-4a8b-a46a-7647f66bfd76 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:31.247740 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77733d-3ab3-4a8b-a46a-7647f66bfd76 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:31.259744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:31.285780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396118df-e19c-4536-ab3b-eb7419234adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:31.286393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396118df-e19c-4536-ab3b-eb7419234adc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:31.286669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396118df-e19c-4536-ab3b-eb7419234adc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:31.286963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396118df-e19c-4536-ab3b-eb7419234adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:31.358291 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396118df-e19c-4536-ab3b-eb7419234adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:31.359861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396118df-e19c-4536-ab3b-eb7419234adc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:31.471267 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 473/932] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:32:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:32:31.477245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36bd3c-ca2f-4c4c-9949-9c348c560aca None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:31.514323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:31.583608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36bd3c-ca2f-4c4c-9949-9c348c560aca None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:31.620492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be4ae7-6abf-44c0-9952-b1ea2ea0590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:31.621154 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be4ae7-6abf-44c0-9952-b1ea2ea0590e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:31.621432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be4ae7-6abf-44c0-9952-b1ea2ea0590e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:31.621701 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be4ae7-6abf-44c0-9952-b1ea2ea0590e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:31.632141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be4ae7-6abf-44c0-9952-b1ea2ea0590e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:31.633596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be4ae7-6abf-44c0-9952-b1ea2ea0590e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-38be4ae7-6abf-44c0-9952-b1ea2ea0590e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:32:31.649585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:31.650722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:32:31.651841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:32:31.651841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:31.651841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:31.651841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 460/933] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:31.656709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396118df-e19c-4536-ab3b-eb7419234adc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:31.668797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:31.759026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396118df-e19c-4536-ab3b-eb7419234adc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:31.795183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482987b-8b94-4727-b0f3-65c9ae35a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:31.796294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482987b-8b94-4727-b0f3-65c9ae35a6ff None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:31.796294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482987b-8b94-4727-b0f3-65c9ae35a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:31.796467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482987b-8b94-4727-b0f3-65c9ae35a6ff None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:31.796957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482987b-8b94-4727-b0f3-65c9ae35a6ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:31.797250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482987b-8b94-4727-b0f3-65c9ae35a6ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:31.798714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482987b-8b94-4727-b0f3-65c9ae35a6ff None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:31.810442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 474/934] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:31.817375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be4ae7-6abf-44c0-9952-b1ea2ea0590e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:31.917319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:31.933407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be4ae7-6abf-44c0-9952-b1ea2ea0590e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:31.969536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79528-ca24-415f-8fe1-5043424d6640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:31.970445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79528-ca24-415f-8fe1-5043424d6640 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:31.970909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79528-ca24-415f-8fe1-5043424d6640 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:31.971226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79528-ca24-415f-8fe1-5043424d6640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:31.978460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda79528-ca24-415f-8fe1-5043424d6640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:31.980171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda79528-ca24-415f-8fe1-5043424d6640 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-dda79528-ca24-415f-8fe1-5043424d6640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:32:31.992302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:31.993411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:31.996003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:32:31.996003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:32:31.996003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:32:31.996003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:32:31.996003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:32:31.996003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:32:31.996003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:32:31.996003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:31.996003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 461/935] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:32:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:31.999594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482987b-8b94-4727-b0f3-65c9ae35a6ff None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:32.076388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:32.110602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482987b-8b94-4727-b0f3-65c9ae35a6ff None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:32.153634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf3d03-95c5-4ba8-9b19-71708586403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:32.154382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf3d03-95c5-4ba8-9b19-71708586403c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:32.154676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf3d03-95c5-4ba8-9b19-71708586403c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:32.154977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf3d03-95c5-4ba8-9b19-71708586403c None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:32.156020 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf3d03-95c5-4ba8-9b19-71708586403c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:32.156429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf3d03-95c5-4ba8-9b19-71708586403c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:32.164955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf3d03-95c5-4ba8-9b19-71708586403c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:32.181410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 475/936] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:32:32.189207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79528-ca24-415f-8fe1-5043424d6640 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:32.297163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79528-ca24-415f-8fe1-5043424d6640 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:32.335163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9c27-0a18-4054-aa12-f42dc1bb2fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:32.335693 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9c27-0a18-4054-aa12-f42dc1bb2fec None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:32.335964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9c27-0a18-4054-aa12-f42dc1bb2fec None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:32.336233 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9c27-0a18-4054-aa12-f42dc1bb2fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:32.337026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9c27-0a18-4054-aa12-f42dc1bb2fec None admin] RBAC: Adding query filter params (role.id=69a1febe83c9483cb6175c815d7e4f8e, scope.project.id=11342796e85b428195cf5155b512162c, user.id=0f040c31c0d4439594404739d44a5435) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:32.337329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9c27-0a18-4054-aa12-f42dc1bb2fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:32.338867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9c27-0a18-4054-aa12-f42dc1bb2fec None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:32.345438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 462/937] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:32:32 2022] GET /identity/v3/role_assignments?user.id=0f040c31c0d4439594404739d44a5435&scope.project.id=11342796e85b428195cf5155b512162c&role.id=69a1febe83c9483cb6175c815d7e4f8e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:34.575129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73090f7b-44fc-4b10-b629-328c19c9af3d None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:34.575722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73090f7b-44fc-4b10-b629-328c19c9af3d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:34.575722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73090f7b-44fc-4b10-b629-328c19c9af3d None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:34.577114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 476/938] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:32:34.583140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb842e-234a-4b20-b5a3-3523ac7cebcc None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:34.583579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb842e-234a-4b20-b5a3-3523ac7cebcc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:34.583689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb842e-234a-4b20-b5a3-3523ac7cebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:34.603160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8bdb842e-234a-4b20-b5a3-3523ac7cebcc None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:32:34.604381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8bdb842e-234a-4b20-b5a3-3523ac7cebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:32:34.607817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:34.674352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 463/939] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:32:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:32:34.943486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73090f7b-44fc-4b10-b629-328c19c9af3d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:35.049420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73090f7b-44fc-4b10-b629-328c19c9af3d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:35.080528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:35.087210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d84e3-17f8-4377-84f9-75ab048a2526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:35.087906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d84e3-17f8-4377-84f9-75ab048a2526 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:35.088234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d84e3-17f8-4377-84f9-75ab048a2526 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:35.088530 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d84e3-17f8-4377-84f9-75ab048a2526 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:35.100320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d84e3-17f8-4377-84f9-75ab048a2526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-678d84e3-17f8-4377-84f9-75ab048a2526 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:32:35.105753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:35.106873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:35.107909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 477/940] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:32:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:35.115737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb842e-234a-4b20-b5a3-3523ac7cebcc None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:35.221577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb842e-234a-4b20-b5a3-3523ac7cebcc None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:35.260304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c003b-7b93-4150-b0f0-66f72ee9a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:35.260936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c003b-7b93-4150-b0f0-66f72ee9a573 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:35.261205 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c003b-7b93-4150-b0f0-66f72ee9a573 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:35.261470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c003b-7b93-4150-b0f0-66f72ee9a573 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:35.262139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c003b-7b93-4150-b0f0-66f72ee9a573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:35.262436 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c003b-7b93-4150-b0f0-66f72ee9a573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:35.263846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c003b-7b93-4150-b0f0-66f72ee9a573 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:35.273946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 464/941] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:32:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:35.279916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d84e3-17f8-4377-84f9-75ab048a2526 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:35.391300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d84e3-17f8-4377-84f9-75ab048a2526 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:35.428916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75614626-95a6-4621-93ad-1601f8bca7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:35.429632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75614626-95a6-4621-93ad-1601f8bca7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:35.429916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75614626-95a6-4621-93ad-1601f8bca7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:35.430257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75614626-95a6-4621-93ad-1601f8bca7c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:35.441024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75614626-95a6-4621-93ad-1601f8bca7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:35.442586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75614626-95a6-4621-93ad-1601f8bca7c1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-75614626-95a6-4621-93ad-1601f8bca7c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:32:35.458635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:35.459748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:32:35.460647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:32:35.460647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:35.460647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:35.460647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 478/942] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:35.466075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c003b-7b93-4150-b0f0-66f72ee9a573 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:35.469224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:35.575241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c003b-7b93-4150-b0f0-66f72ee9a573 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:35.611272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6858d33-a7ad-4e02-81aa-5ecfcca34ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:35.611945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6858d33-a7ad-4e02-81aa-5ecfcca34ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:35.612116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6858d33-a7ad-4e02-81aa-5ecfcca34ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:35.612413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6858d33-a7ad-4e02-81aa-5ecfcca34ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:35.613101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6858d33-a7ad-4e02-81aa-5ecfcca34ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:35.613461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6858d33-a7ad-4e02-81aa-5ecfcca34ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:35.614950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6858d33-a7ad-4e02-81aa-5ecfcca34ac4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:35.627788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 465/943] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:35.634225 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75614626-95a6-4621-93ad-1601f8bca7c1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:35.679758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:35.740882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75614626-95a6-4621-93ad-1601f8bca7c1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:35.778024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ea2a8-2be0-4779-a98f-90d577b84e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:35.778653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ea2a8-2be0-4779-a98f-90d577b84e39 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:35.779009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ea2a8-2be0-4779-a98f-90d577b84e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:35.779326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ea2a8-2be0-4779-a98f-90d577b84e39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:35.787739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ea2a8-2be0-4779-a98f-90d577b84e39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:35.789195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ea2a8-2be0-4779-a98f-90d577b84e39 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-e40ea2a8-2be0-4779-a98f-90d577b84e39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:32:35.800629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:35.801874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:35.802998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 479/944] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:35.807930 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6858d33-a7ad-4e02-81aa-5ecfcca34ac4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:35.876228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:35.925597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6858d33-a7ad-4e02-81aa-5ecfcca34ac4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:35.963051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5f370-4360-4357-838b-f71119fd4355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:35.963659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5f370-4360-4357-838b-f71119fd4355 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:35.963928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5f370-4360-4357-838b-f71119fd4355 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:35.964186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5f370-4360-4357-838b-f71119fd4355 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:35.964911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5f370-4360-4357-838b-f71119fd4355 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:35.965249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5f370-4360-4357-838b-f71119fd4355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:35.966699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5f370-4360-4357-838b-f71119fd4355 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:35.985811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 466/945] 10.222.0.46 () {56 vars in 1143 bytes} [Mon Oct 24 13:32:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:35.991846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ea2a8-2be0-4779-a98f-90d577b84e39 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:36.104140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ea2a8-2be0-4779-a98f-90d577b84e39 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:36.105765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:36.141126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ee39d-a4d3-4716-a28c-35a00e23d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:36.141809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee39d-a4d3-4716-a28c-35a00e23d045 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:36.142023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee39d-a4d3-4716-a28c-35a00e23d045 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:36.142365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee39d-a4d3-4716-a28c-35a00e23d045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:36.154064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ee39d-a4d3-4716-a28c-35a00e23d045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:36.155552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ee39d-a4d3-4716-a28c-35a00e23d045 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ae8ee39d-a4d3-4716-a28c-35a00e23d045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:32:36.172167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:36.173741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:32:36.174724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:32:36.174724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:36.174724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:36.174724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 480/946] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:32:36.178942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5f370-4360-4357-838b-f71119fd4355 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:36.284843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5f370-4360-4357-838b-f71119fd4355 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:36.310495 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:36.330378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98af7b-5d8a-48d8-b49f-f8aad4bd04b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:36.331223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98af7b-5d8a-48d8-b49f-f8aad4bd04b6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:36.331540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98af7b-5d8a-48d8-b49f-f8aad4bd04b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:36.331852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98af7b-5d8a-48d8-b49f-f8aad4bd04b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:36.332560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98af7b-5d8a-48d8-b49f-f8aad4bd04b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:36.332902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98af7b-5d8a-48d8-b49f-f8aad4bd04b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:36.334398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98af7b-5d8a-48d8-b49f-f8aad4bd04b6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:36.346696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 467/947] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:36.352947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ee39d-a4d3-4716-a28c-35a00e23d045 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:36.463660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ee39d-a4d3-4716-a28c-35a00e23d045 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:36.501544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990691a9-a2d3-49a9-81a4-495b68a2de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:36.502255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990691a9-a2d3-49a9-81a4-495b68a2de68 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:36.502480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990691a9-a2d3-49a9-81a4-495b68a2de68 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:36.502742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990691a9-a2d3-49a9-81a4-495b68a2de68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:36.510315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990691a9-a2d3-49a9-81a4-495b68a2de68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:36.511859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990691a9-a2d3-49a9-81a4-495b68a2de68 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-990691a9-a2d3-49a9-81a4-495b68a2de68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:32:36.525482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:36.526602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:36.527532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:32:36.527532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:32:36.527532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:32:36.527532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:32:36.527532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:32:36.527532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:32:36.527532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:32:36.527532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:36.527532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 481/948] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:32:36.532842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98af7b-5d8a-48d8-b49f-f8aad4bd04b6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:36.641198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98af7b-5d8a-48d8-b49f-f8aad4bd04b6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:36.677434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd1d1-bb81-426a-a81f-ded3564f173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:36.678039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd1d1-bb81-426a-a81f-ded3564f173e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:36.678307 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd1d1-bb81-426a-a81f-ded3564f173e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:36.678568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd1d1-bb81-426a-a81f-ded3564f173e None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:36.679362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd1d1-bb81-426a-a81f-ded3564f173e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:36.679709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd1d1-bb81-426a-a81f-ded3564f173e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:36.681212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd1d1-bb81-426a-a81f-ded3564f173e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:36.694367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 468/949] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:32:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:36.700672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990691a9-a2d3-49a9-81a4-495b68a2de68 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:36.721581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:36.812946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990691a9-a2d3-49a9-81a4-495b68a2de68 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:36.848905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62697042-3383-4f84-bed5-13a99ca6cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:36.849738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62697042-3383-4f84-bed5-13a99ca6cf54 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:36.849858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62697042-3383-4f84-bed5-13a99ca6cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:36.850114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62697042-3383-4f84-bed5-13a99ca6cf54 None admin] PATH_INFO: `/v3/projects/11342796e85b428195cf5155b512162c/users/0f040c31c0d4439594404739d44a5435/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:36.852238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62697042-3383-4f84-bed5-13a99ca6cf54 None admin] RBAC: Authorizing `identity:create_grant(project_id=11342796e85b428195cf5155b512162c, user_id=0f040c31c0d4439594404739d44a5435, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:36.853690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62697042-3383-4f84-bed5-13a99ca6cf54 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:36.871581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 482/950] 10.222.0.46 () {58 vars in 1439 bytes} [Mon Oct 24 13:32:36 2022] PUT /identity/v3/projects/11342796e85b428195cf5155b512162c/users/0f040c31c0d4439594404739d44a5435/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:32:39.278982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae261d-d7e9-43dd-985b-7b26a2ed94e8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:39.279595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae261d-d7e9-43dd-985b-7b26a2ed94e8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:39.279595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae261d-d7e9-43dd-985b-7b26a2ed94e8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:39.281031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 469/951] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:32:39.287992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b083e03-5571-4936-946e-15b5f3c07175 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:39.288505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b083e03-5571-4936-946e-15b5f3c07175 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:39.288505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b083e03-5571-4936-946e-15b5f3c07175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:39.309134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9b083e03-5571-4936-946e-15b5f3c07175 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:32:39.310417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9b083e03-5571-4936-946e-15b5f3c07175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:32:39.389086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 483/952] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:32:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:32:39.661753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae261d-d7e9-43dd-985b-7b26a2ed94e8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:39.715595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:39.782040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae261d-d7e9-43dd-985b-7b26a2ed94e8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:39.824474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e8672-6341-40b2-ba6f-f8d6a9d334dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:39.825122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e8672-6341-40b2-ba6f-f8d6a9d334dc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:39.825393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e8672-6341-40b2-ba6f-f8d6a9d334dc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:39.825696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e8672-6341-40b2-ba6f-f8d6a9d334dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:39.837912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e8672-6341-40b2-ba6f-f8d6a9d334dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-cb2e8672-6341-40b2-ba6f-f8d6a9d334dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:32:39.843463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:39.844541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:39.845501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 470/953] 10.222.0.46 () {56 vars in 1096 bytes} [Mon Oct 24 13:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:32:39.851391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b083e03-5571-4936-946e-15b5f3c07175 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:39.854948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:39.974082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b083e03-5571-4936-946e-15b5f3c07175 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:40.011870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a58dab-aaa1-4b10-ae6b-bdb9f7b2c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:40.012475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a58dab-aaa1-4b10-ae6b-bdb9f7b2c56d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:40.012750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a58dab-aaa1-4b10-ae6b-bdb9f7b2c56d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:40.013017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a58dab-aaa1-4b10-ae6b-bdb9f7b2c56d None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:40.013672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a58dab-aaa1-4b10-ae6b-bdb9f7b2c56d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:40.013993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a58dab-aaa1-4b10-ae6b-bdb9f7b2c56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:40.015513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a58dab-aaa1-4b10-ae6b-bdb9f7b2c56d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:40.024239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 484/954] 10.222.0.46 () {56 vars in 1099 bytes} [Mon Oct 24 13:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:32:40.030401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e8672-6341-40b2-ba6f-f8d6a9d334dc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:40.138398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:40.141811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e8672-6341-40b2-ba6f-f8d6a9d334dc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:40.180167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472608c-cc38-4ea3-a9ab-4a882e15eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:40.181226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472608c-cc38-4ea3-a9ab-4a882e15eba9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:40.181534 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472608c-cc38-4ea3-a9ab-4a882e15eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:40.181852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472608c-cc38-4ea3-a9ab-4a882e15eba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:40.192899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472608c-cc38-4ea3-a9ab-4a882e15eba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:40.194447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472608c-cc38-4ea3-a9ab-4a882e15eba9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d472608c-cc38-4ea3-a9ab-4a882e15eba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:32:40.210414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:40.211473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:32:40.212393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:32:40.212393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:40.212393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:40.212393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 471/955] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:40.218255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a58dab-aaa1-4b10-ae6b-bdb9f7b2c56d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:40.299341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:40.335966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a58dab-aaa1-4b10-ae6b-bdb9f7b2c56d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:40.371590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6e851-c80d-4bda-b497-cd05c195caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:40.372195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6e851-c80d-4bda-b497-cd05c195caaf None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:40.372464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6e851-c80d-4bda-b497-cd05c195caaf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:40.372736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6e851-c80d-4bda-b497-cd05c195caaf None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:40.373391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6e851-c80d-4bda-b497-cd05c195caaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:40.373761 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6e851-c80d-4bda-b497-cd05c195caaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:40.375318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6e851-c80d-4bda-b497-cd05c195caaf None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:40.389124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 485/956] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:40.395526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472608c-cc38-4ea3-a9ab-4a882e15eba9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:40.511902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472608c-cc38-4ea3-a9ab-4a882e15eba9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:40.550636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386483d-8c75-4d1f-84c4-fd123afce226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:40.551240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386483d-8c75-4d1f-84c4-fd123afce226 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:40.551539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386483d-8c75-4d1f-84c4-fd123afce226 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:40.551805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386483d-8c75-4d1f-84c4-fd123afce226 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:40.560984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386483d-8c75-4d1f-84c4-fd123afce226 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:40.562477 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386483d-8c75-4d1f-84c4-fd123afce226 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-8386483d-8c75-4d1f-84c4-fd123afce226 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:32:40.574191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:40.575754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:40.576722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 472/957] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:40.581564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6e851-c80d-4bda-b497-cd05c195caaf None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:40.686867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6e851-c80d-4bda-b497-cd05c195caaf None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:40.714301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:40.724153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20b9bf-e566-4835-84e2-3ef6f7cb6b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:40.724749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20b9bf-e566-4835-84e2-3ef6f7cb6b37 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:40.725021 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20b9bf-e566-4835-84e2-3ef6f7cb6b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:40.725287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20b9bf-e566-4835-84e2-3ef6f7cb6b37 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:40.726009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20b9bf-e566-4835-84e2-3ef6f7cb6b37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:40.726304 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20b9bf-e566-4835-84e2-3ef6f7cb6b37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:40.727771 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20b9bf-e566-4835-84e2-3ef6f7cb6b37 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:40.746168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 486/958] 10.222.0.46 () {56 vars in 1143 bytes} [Mon Oct 24 13:32:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:40.752938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386483d-8c75-4d1f-84c4-fd123afce226 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:40.770197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:40.865613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386483d-8c75-4d1f-84c4-fd123afce226 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:40.906731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330394f-5309-44d5-877b-5f9b449fe5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:40.907514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330394f-5309-44d5-877b-5f9b449fe5ac None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:40.907867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330394f-5309-44d5-877b-5f9b449fe5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:40.908136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330394f-5309-44d5-877b-5f9b449fe5ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:40.982662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330394f-5309-44d5-877b-5f9b449fe5ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:40.984163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330394f-5309-44d5-877b-5f9b449fe5ac None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:40.998480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:41.092376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 473/959] 10.222.0.46 () {58 vars in 1282 bytes} [Mon Oct 24 13:32:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:32:41.098807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20b9bf-e566-4835-84e2-3ef6f7cb6b37 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:41.203499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20b9bf-e566-4835-84e2-3ef6f7cb6b37 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:41.240539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d645aa-be75-4676-b30c-afb5bd7a22db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:41.241160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d645aa-be75-4676-b30c-afb5bd7a22db None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:41.241438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d645aa-be75-4676-b30c-afb5bd7a22db None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:41.241718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d645aa-be75-4676-b30c-afb5bd7a22db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:41.253170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d645aa-be75-4676-b30c-afb5bd7a22db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:41.254827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d645aa-be75-4676-b30c-afb5bd7a22db None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-94d645aa-be75-4676-b30c-afb5bd7a22db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:32:41.271585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:41.272698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:32:41.274026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:32:41.274026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:32:41.274026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:41.274026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 487/960] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:41.278935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330394f-5309-44d5-877b-5f9b449fe5ac None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:41.385611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330394f-5309-44d5-877b-5f9b449fe5ac None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:41.399742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:41.422291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94f67-d905-4847-a831-062ac75cb52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:41.423168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94f67-d905-4847-a831-062ac75cb52e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:41.423574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94f67-d905-4847-a831-062ac75cb52e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:41.423902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94f67-d905-4847-a831-062ac75cb52e None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:41.424666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f94f67-d905-4847-a831-062ac75cb52e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:41.425040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f94f67-d905-4847-a831-062ac75cb52e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:41.426727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f94f67-d905-4847-a831-062ac75cb52e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:41.440344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 474/961] 10.222.0.46 () {56 vars in 1109 bytes} [Mon Oct 24 13:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:41.446238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d645aa-be75-4676-b30c-afb5bd7a22db None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:41.489536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:41.561603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d645aa-be75-4676-b30c-afb5bd7a22db None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:41.603308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d148d61-f477-41a9-b773-11d6141bde12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:41.603929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d148d61-f477-41a9-b773-11d6141bde12 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:41.604203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d148d61-f477-41a9-b773-11d6141bde12 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:41.604562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d148d61-f477-41a9-b773-11d6141bde12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:41.612068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d148d61-f477-41a9-b773-11d6141bde12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:41.613524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d148d61-f477-41a9-b773-11d6141bde12 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-8d148d61-f477-41a9-b773-11d6141bde12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:32:41.626551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:41.627661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:41.628584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:32:41.628584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:32:41.628584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:32:41.628584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:32:41.628584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:32:41.628584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:32:41.628584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:32:41.628584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Oct 24 13:32:41.628584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 488/962] 10.222.0.46 () {56 vars in 1111 bytes} [Mon Oct 24 13:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:41.634221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94f67-d905-4847-a831-062ac75cb52e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:41.741076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94f67-d905-4847-a831-062ac75cb52e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:41.776678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d6a98-4eb0-4378-ad0a-21352226de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:41.777271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6a98-4eb0-4378-ad0a-21352226de58 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:41.777560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6a98-4eb0-4378-ad0a-21352226de58 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:41.777829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6a98-4eb0-4378-ad0a-21352226de58 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:41.778512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6a98-4eb0-4378-ad0a-21352226de58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:41.778810 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6a98-4eb0-4378-ad0a-21352226de58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:41.780284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6a98-4eb0-4378-ad0a-21352226de58 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:41.793739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 475/963] 10.222.0.46 () {56 vars in 1148 bytes} [Mon Oct 24 13:32:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:41.800952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d148d61-f477-41a9-b773-11d6141bde12 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:41.909652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:41.916281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d148d61-f477-41a9-b773-11d6141bde12 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:41.953363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce4004-50cb-47b6-b9bc-5a918a8a9296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:41.954197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4004-50cb-47b6-b9bc-5a918a8a9296 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:41.954530 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4004-50cb-47b6-b9bc-5a918a8a9296 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:41.954792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4004-50cb-47b6-b9bc-5a918a8a9296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:41.955599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce4004-50cb-47b6-b9bc-5a918a8a9296 None admin] RBAC: Adding query filter params (role.id=581091dd624142d3aad6710d1eb0affa, scope.project.id=11342796e85b428195cf5155b512162c, user.id=0f040c31c0d4439594404739d44a5435) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:41.955896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce4004-50cb-47b6-b9bc-5a918a8a9296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:41.957669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce4004-50cb-47b6-b9bc-5a918a8a9296 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:41.963875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 489/964] 10.222.0.46 () {56 vars in 1374 bytes} [Mon Oct 24 13:32:41 2022] GET /identity/v3/role_assignments?user.id=0f040c31c0d4439594404739d44a5435&scope.project.id=11342796e85b428195cf5155b512162c&role.id=581091dd624142d3aad6710d1eb0affa => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:32:44.115950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4db7d4-71c7-4e5f-99e9-b6033440e798 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:44.116854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4db7d4-71c7-4e5f-99e9-b6033440e798 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:44.116854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4db7d4-71c7-4e5f-99e9-b6033440e798 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:44.118872 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 476/965] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:32:44.127071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555213e-5e61-41e9-91d6-eea8ec465b9a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:44.127503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555213e-5e61-41e9-91d6-eea8ec465b9a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:44.127601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555213e-5e61-41e9-91d6-eea8ec465b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:44.147903 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d555213e-5e61-41e9-91d6-eea8ec465b9a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:32:44.149059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d555213e-5e61-41e9-91d6-eea8ec465b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:32:44.219186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 490/966] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:32:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:32:44.484700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4db7d4-71c7-4e5f-99e9-b6033440e798 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:44.528802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:44.612212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4db7d4-71c7-4e5f-99e9-b6033440e798 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:44.648519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b37c-682b-4e9b-b7cb-d53d4f880bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:44.649064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b37c-682b-4e9b-b7cb-d53d4f880bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:44.649337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b37c-682b-4e9b-b7cb-d53d4f880bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:44.649603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b37c-682b-4e9b-b7cb-d53d4f880bb0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:44.650178 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b37c-682b-4e9b-b7cb-d53d4f880bb0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:44.651567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b37c-682b-4e9b-b7cb-d53d4f880bb0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f101b37c-682b-4e9b-b7cb-d53d4f880bb0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:44.660847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:44.662028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:44.663152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 477/967] 10.222.0.46 () {56 vars in 1117 bytes} [Mon Oct 24 13:32:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:44.668628 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555213e-5e61-41e9-91d6-eea8ec465b9a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:44.769394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:44.783324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555213e-5e61-41e9-91d6-eea8ec465b9a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:44.819048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7400a-cf45-453f-98bd-9c7c3cbafc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:44.819642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7400a-cf45-453f-98bd-9c7c3cbafc3e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:44.819918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7400a-cf45-453f-98bd-9c7c3cbafc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:44.820185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7400a-cf45-453f-98bd-9c7c3cbafc3e None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:44.820858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7400a-cf45-453f-98bd-9c7c3cbafc3e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:44.821080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7400a-cf45-453f-98bd-9c7c3cbafc3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:44.822477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7400a-cf45-453f-98bd-9c7c3cbafc3e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:44.827539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 491/968] 10.222.0.46 () {56 vars in 1116 bytes} [Mon Oct 24 13:32:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:44.836641 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b37c-682b-4e9b-b7cb-d53d4f880bb0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:44.940987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:44.946906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b37c-682b-4e9b-b7cb-d53d4f880bb0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:44.981305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14087-1a7e-4d87-ae02-0aa17fa93531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:44.981905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14087-1a7e-4d87-ae02-0aa17fa93531 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:44.982170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14087-1a7e-4d87-ae02-0aa17fa93531 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:44.982426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14087-1a7e-4d87-ae02-0aa17fa93531 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:44.983107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e14087-1a7e-4d87-ae02-0aa17fa93531 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:44.983400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e14087-1a7e-4d87-ae02-0aa17fa93531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:44.986303 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e14087-1a7e-4d87-ae02-0aa17fa93531 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:44.989645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 478/969] 10.222.0.46 () {56 vars in 1116 bytes} [Mon Oct 24 13:32:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:47.119540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beac53-3bb6-4098-b612-ac3c4f7c8af6 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:47.120454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beac53-3bb6-4098-b612-ac3c4f7c8af6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:47.120454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beac53-3bb6-4098-b612-ac3c4f7c8af6 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:47.122539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 492/970] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:32:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:32:47.128146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069e90-bcc6-4f90-b498-9226d43f46d6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:47.128590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069e90-bcc6-4f90-b498-9226d43f46d6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:47.128682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069e90-bcc6-4f90-b498-9226d43f46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:47.150095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e4069e90-bcc6-4f90-b498-9226d43f46d6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:32:47.151314 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e4069e90-bcc6-4f90-b498-9226d43f46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:32:47.232657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 479/971] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:32:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:32:47.502707 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beac53-3bb6-4098-b612-ac3c4f7c8af6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:47.612750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beac53-3bb6-4098-b612-ac3c4f7c8af6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:47.654269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886bd72-47e6-4215-b5a2-521da4ce2efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:47.654793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886bd72-47e6-4215-b5a2-521da4ce2efe None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:47.655225 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886bd72-47e6-4215-b5a2-521da4ce2efe None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:47.655493 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886bd72-47e6-4215-b5a2-521da4ce2efe None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:47.656142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886bd72-47e6-4215-b5a2-521da4ce2efe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:47.657637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886bd72-47e6-4215-b5a2-521da4ce2efe None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:47.676319 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 493/972] 10.222.0.46 () {60 vars in 1141 bytes} [Mon Oct 24 13:32:47 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:32:49.833609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2f8a7-2ce3-4dc4-b93d-aebaa4dbd62c None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:49.834446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2f8a7-2ce3-4dc4-b93d-aebaa4dbd62c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:49.834446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2f8a7-2ce3-4dc4-b93d-aebaa4dbd62c None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:49.836665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 480/973] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:32:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:32:49.843131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13439aa5-fe2a-4351-a3d8-fcd196da5412 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:49.843580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13439aa5-fe2a-4351-a3d8-fcd196da5412 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:49.843673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13439aa5-fe2a-4351-a3d8-fcd196da5412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:49.864248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-13439aa5-fe2a-4351-a3d8-fcd196da5412 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:32:49.865571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-13439aa5-fe2a-4351-a3d8-fcd196da5412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:32:49.876391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:49.953406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 494/974] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:32:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:32:50.217069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2f8a7-2ce3-4dc4-b93d-aebaa4dbd62c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:50.312902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:50.325295 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2f8a7-2ce3-4dc4-b93d-aebaa4dbd62c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:50.360166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220d4ca-9c97-4ee4-9754-f86e46985b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:50.360884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220d4ca-9c97-4ee4-9754-f86e46985b25 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:50.361157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220d4ca-9c97-4ee4-9754-f86e46985b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:50.361424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220d4ca-9c97-4ee4-9754-f86e46985b25 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:50.362003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220d4ca-9c97-4ee4-9754-f86e46985b25 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:50.363401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220d4ca-9c97-4ee4-9754-f86e46985b25 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-9220d4ca-9c97-4ee4-9754-f86e46985b25 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:50.372433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:50.373532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:50.374618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 481/975] 10.222.0.46 () {56 vars in 1117 bytes} [Mon Oct 24 13:32:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:50.379903 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13439aa5-fe2a-4351-a3d8-fcd196da5412 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:50.485065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13439aa5-fe2a-4351-a3d8-fcd196da5412 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:50.520738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224d98-567a-447f-870c-2b81c3a848f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:50.521329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224d98-567a-447f-870c-2b81c3a848f8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:50.521604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224d98-567a-447f-870c-2b81c3a848f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:50.521869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224d98-567a-447f-870c-2b81c3a848f8 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:50.522490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95224d98-567a-447f-870c-2b81c3a848f8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:50.522787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95224d98-567a-447f-870c-2b81c3a848f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:50.524204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95224d98-567a-447f-870c-2b81c3a848f8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:50.529591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 495/976] 10.222.0.46 () {56 vars in 1116 bytes} [Mon Oct 24 13:32:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:50.535887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220d4ca-9c97-4ee4-9754-f86e46985b25 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:50.656126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220d4ca-9c97-4ee4-9754-f86e46985b25 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:50.691809 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8aa9a-b1be-4a36-b0c7-fa52c81da8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:50.692397 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8aa9a-b1be-4a36-b0c7-fa52c81da8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:50.692665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8aa9a-b1be-4a36-b0c7-fa52c81da8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:50.692931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8aa9a-b1be-4a36-b0c7-fa52c81da8e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:50.693626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8aa9a-b1be-4a36-b0c7-fa52c81da8e1 None admin] RBAC: Adding query filter params (interface=public, service_id=859f0482f05b4919855a8af8ddb97c54, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:50.693924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8aa9a-b1be-4a36-b0c7-fa52c81da8e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:50.695312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8aa9a-b1be-4a36-b0c7-fa52c81da8e1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:50.700385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 482/977] 10.222.0.46 () {56 vars in 1251 bytes} [Mon Oct 24 13:32:50 2022] GET /identity/v3/endpoints?service_id=859f0482f05b4919855a8af8ddb97c54&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:32:50.709269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224d98-567a-447f-870c-2b81c3a848f8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:50.713773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:50.817173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224d98-567a-447f-870c-2b81c3a848f8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:50.853658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4bb88-0165-4d4a-80e2-7cdb37a542c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:50.854277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4bb88-0165-4d4a-80e2-7cdb37a542c4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:50.854520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4bb88-0165-4d4a-80e2-7cdb37a542c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:50.854787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4bb88-0165-4d4a-80e2-7cdb37a542c4 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:50.855420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4bb88-0165-4d4a-80e2-7cdb37a542c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:50.857694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4bb88-0165-4d4a-80e2-7cdb37a542c4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:50.868827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 496/978] 10.222.0.46 () {56 vars in 1087 bytes} [Mon Oct 24 13:32:50 2022] GET /identity/v3/services => generated 2191 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:32:52.985452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b2b6-49ef-456d-a412-76553c1e6656 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:52.986296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b2b6-49ef-456d-a412-76553c1e6656 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:52.986463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b2b6-49ef-456d-a412-76553c1e6656 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:52.988548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 483/979] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:32:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:32:52.997082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b937bd-81f4-4dfc-901d-dde80aa7d85e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:52.997770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b937bd-81f4-4dfc-901d-dde80aa7d85e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:52.997914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b937bd-81f4-4dfc-901d-dde80aa7d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:53.019124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e1b937bd-81f4-4dfc-901d-dde80aa7d85e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:32:53.020306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e1b937bd-81f4-4dfc-901d-dde80aa7d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:32:53.083425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:53.091969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 497/980] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:32:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:32:53.357837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b2b6-49ef-456d-a412-76553c1e6656 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:53.390957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:53.477528 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b2b6-49ef-456d-a412-76553c1e6656 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:53.513093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925fff-a038-4fc2-bf45-5172563e6d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:53.513700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925fff-a038-4fc2-bf45-5172563e6d5a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:53.513966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925fff-a038-4fc2-bf45-5172563e6d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:53.514226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925fff-a038-4fc2-bf45-5172563e6d5a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:53.514796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a925fff-a038-4fc2-bf45-5172563e6d5a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:53.516165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a925fff-a038-4fc2-bf45-5172563e6d5a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-1a925fff-a038-4fc2-bf45-5172563e6d5a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:32:53.525709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:32:53.526940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Oct 24 13:32:53.527811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 484/981] 10.222.0.46 () {56 vars in 1117 bytes} [Mon Oct 24 13:32:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:32:53.533236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b937bd-81f4-4dfc-901d-dde80aa7d85e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:53.635643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b937bd-81f4-4dfc-901d-dde80aa7d85e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:53.670997 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b354f6a-ff24-4f02-afc3-315553b8fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:53.671592 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354f6a-ff24-4f02-afc3-315553b8fb29 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:53.671901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354f6a-ff24-4f02-afc3-315553b8fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:53.672152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354f6a-ff24-4f02-afc3-315553b8fb29 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:53.672765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b354f6a-ff24-4f02-afc3-315553b8fb29 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:32:53.673081 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b354f6a-ff24-4f02-afc3-315553b8fb29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:53.674432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b354f6a-ff24-4f02-afc3-315553b8fb29 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:53.679445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 498/982] 10.222.0.46 () {56 vars in 1116 bytes} [Mon Oct 24 13:32:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:32:53.687976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925fff-a038-4fc2-bf45-5172563e6d5a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:32:53.772638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:53.796891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925fff-a038-4fc2-bf45-5172563e6d5a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:32:53.833867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91965e3a-605b-4d04-9488-f4745f1e8ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:32:53.834456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965e3a-605b-4d04-9488-f4745f1e8ff9 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:32:53.834727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965e3a-605b-4d04-9488-f4745f1e8ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:32:53.835014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965e3a-605b-4d04-9488-f4745f1e8ff9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:32:53.835682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91965e3a-605b-4d04-9488-f4745f1e8ff9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:32:53.837039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91965e3a-605b-4d04-9488-f4745f1e8ff9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:32:53.862618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 485/983] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:32:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:33:03.677038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=69 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:03.856038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:58.154836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3791a-57b7-423e-8483-a7223315fb1b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:33:58.155899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3791a-57b7-423e-8483-a7223315fb1b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:33:58.156389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3791a-57b7-423e-8483-a7223315fb1b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:33:58.162072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 499/984] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:33:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:33:58.163514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52bf0f-c0e0-44c1-a21e-adb1f3d7c442 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:33:58.163946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52bf0f-c0e0-44c1-a21e-adb1f3d7c442 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:33:58.164108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52bf0f-c0e0-44c1-a21e-adb1f3d7c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:33:58.247683 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5d52bf0f-c0e0-44c1-a21e-adb1f3d7c442 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:33:58.249011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5d52bf0f-c0e0-44c1-a21e-adb1f3d7c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:33:58.425692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 486/985] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:33:58.720368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a74d-e828-4202-b2c2-bc9f29caa39d None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:33:58.721014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a74d-e828-4202-b2c2-bc9f29caa39d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:33:58.721475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a74d-e828-4202-b2c2-bc9f29caa39d None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:33:58.723507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 500/986] 10.222.0.46 () {54 vars in 964 bytes} [Mon Oct 24 13:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:33:58.729873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b407fc-fc79-4e8b-9566-a1df2105e869 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:33:58.730148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b407fc-fc79-4e8b-9566-a1df2105e869 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:33:58.730417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b407fc-fc79-4e8b-9566-a1df2105e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:33:58.817287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c3b407fc-fc79-4e8b-9566-a1df2105e869 None None] MFA Rules not processed for user `fe801da792944be2b6342c483bcb88b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:33:58.818511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c3b407fc-fc79-4e8b-9566-a1df2105e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:33:58.841135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:58.913960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a74d-e828-4202-b2c2-bc9f29caa39d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:33:58.916136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ed46a74d-e828-4202-b2c2-bc9f29caa39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:33:58.920669 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 487/987] 10.222.0.46 () {58 vars in 1061 bytes} [Mon Oct 24 13:33:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:33:59.031031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a74d-e828-4202-b2c2-bc9f29caa39d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:33:59.117739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31366e-8023-4103-8e68-515d57d54aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:33:59.118362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31366e-8023-4103-8e68-515d57d54aaf service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:33:59.118638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31366e-8023-4103-8e68-515d57d54aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:33:59.118901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31366e-8023-4103-8e68-515d57d54aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:33:59.121082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5d31366e-8023-4103-8e68-515d57d54aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:33:59.189041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:59.257614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31366e-8023-4103-8e68-515d57d54aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:33:59.259144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31366e-8023-4103-8e68-515d57d54aaf service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:33:59.281447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 501/988] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:01.750672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055634c7-a17f-40f4-a191-34944ece9bf4 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:01.751286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055634c7-a17f-40f4-a191-34944ece9bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:01.751286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055634c7-a17f-40f4-a191-34944ece9bf4 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:01.752498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 488/989] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:01.758615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9d6c5-a185-41a0-8853-d15ca052d5d4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:01.759201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9d6c5-a185-41a0-8853-d15ca052d5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:01.759201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9d6c5-a185-41a0-8853-d15ca052d5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:01.839922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a9d9d6c5-a185-41a0-8853-d15ca052d5d4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:01.841163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a9d9d6c5-a185-41a0-8853-d15ca052d5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:01.940854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 502/990] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:02.226144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055634c7-a17f-40f4-a191-34944ece9bf4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:02.228660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-055634c7-a17f-40f4-a191-34944ece9bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:02.354391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055634c7-a17f-40f4-a191-34944ece9bf4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:02.427173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:02.429963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80d366-f81d-412a-8183-21af1674d0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:02.430822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d366-f81d-412a-8183-21af1674d0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:02.431194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d366-f81d-412a-8183-21af1674d0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:02.431682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d366-f81d-412a-8183-21af1674d0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:02.433638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6a80d366-f81d-412a-8183-21af1674d0a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:02.553017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80d366-f81d-412a-8183-21af1674d0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:02.554451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80d366-f81d-412a-8183-21af1674d0a1 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:02.572880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 489/991] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:05.068346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7cd0d-4e06-4bc5-9584-c06f76b9c528 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:05.069106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7cd0d-4e06-4bc5-9584-c06f76b9c528 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:05.069106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7cd0d-4e06-4bc5-9584-c06f76b9c528 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:05.071199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 503/992] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:05.079542 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c86f68-6ca4-49be-ad4f-dcb4b9748031 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:05.079969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c86f68-6ca4-49be-ad4f-dcb4b9748031 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:05.080058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c86f68-6ca4-49be-ad4f-dcb4b9748031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:05.160363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-91c86f68-6ca4-49be-ad4f-dcb4b9748031 None None] MFA Rules not processed for user `a81ae024eaed4561b6054d1bab23312a`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:05.161562 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-91c86f68-6ca4-49be-ad4f-dcb4b9748031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:05.215160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:05.259807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 490/993] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:05.549471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7cd0d-4e06-4bc5-9584-c06f76b9c528 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:05.552002 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d9d7cd0d-4e06-4bc5-9584-c06f76b9c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:05.567510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:05.670072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7cd0d-4e06-4bc5-9584-c06f76b9c528 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:05.757895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f153-ca0b-4464-a995-3ae449ddad75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:05.758494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f153-ca0b-4464-a995-3ae449ddad75 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:05.758768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f153-ca0b-4464-a995-3ae449ddad75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:05.759068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f153-ca0b-4464-a995-3ae449ddad75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:05.760647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e978f153-ca0b-4464-a995-3ae449ddad75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:05.822701 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:05.870544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f153-ca0b-4464-a995-3ae449ddad75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:05.872328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f153-ca0b-4464-a995-3ae449ddad75 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:05.898385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 504/994] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:08.634546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8c90-c49a-497f-9731-6db1bf712160 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:08.635510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8c90-c49a-497f-9731-6db1bf712160 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:08.635510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8c90-c49a-497f-9731-6db1bf712160 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:08.637438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 491/995] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:08.646828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d3523-1dbc-47ad-a732-51639b128b0b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:08.647306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d3523-1dbc-47ad-a732-51639b128b0b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:08.647410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d3523-1dbc-47ad-a732-51639b128b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:08.718657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-170d3523-1dbc-47ad-a732-51639b128b0b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:08.719911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-170d3523-1dbc-47ad-a732-51639b128b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:08.826943 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 505/996] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:09.126460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8c90-c49a-497f-9731-6db1bf712160 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:09.128931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5f1f8c90-c49a-497f-9731-6db1bf712160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:09.246690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8c90-c49a-497f-9731-6db1bf712160 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:09.326556 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f455a-ab07-49ad-9437-4c3836425de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:09.327208 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f455a-ab07-49ad-9437-4c3836425de4 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:09.327472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f455a-ab07-49ad-9437-4c3836425de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:09.327740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f455a-ab07-49ad-9437-4c3836425de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:09.329322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ca7f455a-ab07-49ad-9437-4c3836425de4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:09.336444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:09.444632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f455a-ab07-49ad-9437-4c3836425de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:09.446068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f455a-ab07-49ad-9437-4c3836425de4 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:09.464878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 492/997] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:12.281094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c196b9-594a-4ad0-bf4f-08a4073ce3d2 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:12.281671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c196b9-594a-4ad0-bf4f-08a4073ce3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:12.281671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c196b9-594a-4ad0-bf4f-08a4073ce3d2 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:12.283039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 506/998] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:12.288529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7b3d-d555-4fb8-8aed-dedabc51ca26 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:12.288964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7b3d-d555-4fb8-8aed-dedabc51ca26 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:12.289079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7b3d-d555-4fb8-8aed-dedabc51ca26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:12.366715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2c5a7b3d-d555-4fb8-8aed-dedabc51ca26 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:12.367885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2c5a7b3d-d555-4fb8-8aed-dedabc51ca26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:12.436427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:12.479757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 493/999] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:12.774373 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb91dcb-73fd-47ce-adc4-3d83594b0573 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:12.774646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb91dcb-73fd-47ce-adc4-3d83594b0573 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:12.774946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb91dcb-73fd-47ce-adc4-3d83594b0573 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:12.776357 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 507/1000] 10.222.0.46 () {54 vars in 964 bytes} [Mon Oct 24 13:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:12.782717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc235-959e-423a-96a7-0f61ed36c463 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:12.783058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc235-959e-423a-96a7-0f61ed36c463 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:12.783329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc235-959e-423a-96a7-0f61ed36c463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:12.865957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-365cc235-959e-423a-96a7-0f61ed36c463 None None] MFA Rules not processed for user `fe801da792944be2b6342c483bcb88b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:12.867491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-365cc235-959e-423a-96a7-0f61ed36c463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:12.948126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 494/1001] 10.222.0.46 () {58 vars in 1061 bytes} [Mon Oct 24 13:34:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:12.957478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb91dcb-73fd-47ce-adc4-3d83594b0573 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:12.959068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cfb91dcb-73fd-47ce-adc4-3d83594b0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:12.979771 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:13.065009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb91dcb-73fd-47ce-adc4-3d83594b0573 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:13.141286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accba4bc-9464-46ba-bdf9-f1b11bbc9a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:13.141890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accba4bc-9464-46ba-bdf9-f1b11bbc9a56 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:13.142163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accba4bc-9464-46ba-bdf9-f1b11bbc9a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:13.142436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accba4bc-9464-46ba-bdf9-f1b11bbc9a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:13.144057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-accba4bc-9464-46ba-bdf9-f1b11bbc9a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:13.218654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:13.256760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accba4bc-9464-46ba-bdf9-f1b11bbc9a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:13.258214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accba4bc-9464-46ba-bdf9-f1b11bbc9a56 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:13.277540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 508/1002] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:15.736004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa8b4e-23a3-4a25-a34d-06b176521ce1 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:15.736595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa8b4e-23a3-4a25-a34d-06b176521ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:15.736595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa8b4e-23a3-4a25-a34d-06b176521ce1 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:15.737780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 495/1003] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:15.743356 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21e8f-ebfe-4f99-a10a-cbe7931eb752 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:15.743783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21e8f-ebfe-4f99-a10a-cbe7931eb752 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:15.744032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21e8f-ebfe-4f99-a10a-cbe7931eb752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:15.811265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-27e21e8f-ebfe-4f99-a10a-cbe7931eb752 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:15.812474 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-27e21e8f-ebfe-4f99-a10a-cbe7931eb752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:15.908712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 509/1004] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:16.184186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa8b4e-23a3-4a25-a34d-06b176521ce1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:16.186039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-02aa8b4e-23a3-4a25-a34d-06b176521ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:16.247887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:16.295231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa8b4e-23a3-4a25-a34d-06b176521ce1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:16.368301 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f009d-7645-411c-8b1b-15f84d8a134c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:16.368822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f009d-7645-411c-8b1b-15f84d8a134c service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:16.369093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f009d-7645-411c-8b1b-15f84d8a134c service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:16.369355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f009d-7645-411c-8b1b-15f84d8a134c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:16.370970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-372f009d-7645-411c-8b1b-15f84d8a134c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:16.485595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:16.488458 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f009d-7645-411c-8b1b-15f84d8a134c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:16.490189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f009d-7645-411c-8b1b-15f84d8a134c service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:16.510484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 496/1005] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:18.739645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805b13-9d81-4ba9-a209-f241f3d32e47 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:18.740119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805b13-9d81-4ba9-a209-f241f3d32e47 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:18.740322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805b13-9d81-4ba9-a209-f241f3d32e47 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:18.741548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 510/1006] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:18.747087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0ce2c-43e1-46d5-8ea4-87d7c8cf88ff None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:18.747552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0ce2c-43e1-46d5-8ea4-87d7c8cf88ff None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:18.747659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0ce2c-43e1-46d5-8ea4-87d7c8cf88ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:18.814890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-25e0ce2c-43e1-46d5-8ea4-87d7c8cf88ff None None] MFA Rules not processed for user `a81ae024eaed4561b6054d1bab23312a`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:18.816114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-25e0ce2c-43e1-46d5-8ea4-87d7c8cf88ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:18.918627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 497/1007] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:19.200385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805b13-9d81-4ba9-a209-f241f3d32e47 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:19.201920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5b805b13-9d81-4ba9-a209-f241f3d32e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:19.237962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:19.312099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805b13-9d81-4ba9-a209-f241f3d32e47 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:19.391091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a6e81-2c7e-4ad3-b3ea-dfa3b802f2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:19.391687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6e81-2c7e-4ad3-b3ea-dfa3b802f2ea service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:19.391978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6e81-2c7e-4ad3-b3ea-dfa3b802f2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:19.392239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6e81-2c7e-4ad3-b3ea-dfa3b802f2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:19.393812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bb1a6e81-2c7e-4ad3-b3ea-dfa3b802f2ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:19.475048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:19.509626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a6e81-2c7e-4ad3-b3ea-dfa3b802f2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:19.511125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a6e81-2c7e-4ad3-b3ea-dfa3b802f2ea service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:19.530631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 511/1008] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:21.926317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fffc78-ca49-4982-9245-c2ae2e5a321e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:21.926911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fffc78-ca49-4982-9245-c2ae2e5a321e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:21.927201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fffc78-ca49-4982-9245-c2ae2e5a321e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:21.928570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 498/1009] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:21.935271 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85cfb-0fe0-48fd-aec4-4b971e8949d9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:21.936010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85cfb-0fe0-48fd-aec4-4b971e8949d9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:21.936165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85cfb-0fe0-48fd-aec4-4b971e8949d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:22.008526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f6f85cfb-0fe0-48fd-aec4-4b971e8949d9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:22.009739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f6f85cfb-0fe0-48fd-aec4-4b971e8949d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:22.114179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 512/1010] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:22.398795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fffc78-ca49-4982-9245-c2ae2e5a321e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:22.400350 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a2fffc78-ca49-4982-9245-c2ae2e5a321e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:22.468728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:22.503244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fffc78-ca49-4982-9245-c2ae2e5a321e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:22.579397 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc579d-4810-4d5c-808f-9e962050b21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:22.579999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc579d-4810-4d5c-808f-9e962050b21f service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:22.580272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc579d-4810-4d5c-808f-9e962050b21f service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:22.580536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc579d-4810-4d5c-808f-9e962050b21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:22.582165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-18cc579d-4810-4d5c-808f-9e962050b21f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:22.703733 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc579d-4810-4d5c-808f-9e962050b21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:22.705073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc579d-4810-4d5c-808f-9e962050b21f service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:22.715553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:22.724148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 499/1011] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:24.976316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86bc21-c337-435b-b5e3-e67225c79533 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:24.977233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86bc21-c337-435b-b5e3-e67225c79533 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:24.977233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86bc21-c337-435b-b5e3-e67225c79533 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:24.979349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 513/1012] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:24.988169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c06d-1ce7-470e-b585-065f0b07e2a7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:24.988957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c06d-1ce7-470e-b585-065f0b07e2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:24.989149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c06d-1ce7-470e-b585-065f0b07e2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:25.065833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0a62c06d-1ce7-470e-b585-065f0b07e2a7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:25.067166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0a62c06d-1ce7-470e-b585-065f0b07e2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:25.167264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 500/1013] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:25.450481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86bc21-c337-435b-b5e3-e67225c79533 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:25.453092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7b86bc21-c337-435b-b5e3-e67225c79533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:25.496487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:25.565233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86bc21-c337-435b-b5e3-e67225c79533 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:25.653282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e08d4-e1b1-4486-aef7-9b43a7988867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:25.653803 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e08d4-e1b1-4486-aef7-9b43a7988867 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:25.654075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e08d4-e1b1-4486-aef7-9b43a7988867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:25.654342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e08d4-e1b1-4486-aef7-9b43a7988867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:25.655962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d62e08d4-e1b1-4486-aef7-9b43a7988867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:25.744652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:25.772300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e08d4-e1b1-4486-aef7-9b43a7988867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:25.773755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e08d4-e1b1-4486-aef7-9b43a7988867 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:25.793572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 514/1014] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:28.387906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024dd50-6240-4dd8-9b09-085665942420 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:28.388349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024dd50-6240-4dd8-9b09-085665942420 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:28.388438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024dd50-6240-4dd8-9b09-085665942420 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:28.389767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 501/1015] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:28.396108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98e887-ed8c-46b4-9319-1047b881c564 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:28.396550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98e887-ed8c-46b4-9319-1047b881c564 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:28.396650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98e887-ed8c-46b4-9319-1047b881c564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:28.469027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bc98e887-ed8c-46b4-9319-1047b881c564 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:28.470256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bc98e887-ed8c-46b4-9319-1047b881c564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:28.578114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 515/1016] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:28.862496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024dd50-6240-4dd8-9b09-085665942420 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:28.864191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d024dd50-6240-4dd8-9b09-085665942420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:28.944364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:28.973650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024dd50-6240-4dd8-9b09-085665942420 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:29.052982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed2165-6bf5-4aea-b591-49ff29d6668a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:29.053612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed2165-6bf5-4aea-b591-49ff29d6668a service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:29.053881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed2165-6bf5-4aea-b591-49ff29d6668a service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:29.054107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed2165-6bf5-4aea-b591-49ff29d6668a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:29.055748 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-82ed2165-6bf5-4aea-b591-49ff29d6668a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:29.177666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed2165-6bf5-4aea-b591-49ff29d6668a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:29.179053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed2165-6bf5-4aea-b591-49ff29d6668a service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:29.197461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 502/1017] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:34:33.309204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4f8c-f117-42cb-94bf-f5a31c0de482 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:33.309733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4f8c-f117-42cb-94bf-f5a31c0de482 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:33.309733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4f8c-f117-42cb-94bf-f5a31c0de482 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:33.311340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 516/1018] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:33.317228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ece70-4b4d-4031-9323-de3fe52f72d0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:33.317637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ece70-4b4d-4031-9323-de3fe52f72d0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:33.317805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ece70-4b4d-4031-9323-de3fe52f72d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:33.323538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:33.389546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-561ece70-4b4d-4031-9323-de3fe52f72d0 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:33.390781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-561ece70-4b4d-4031-9323-de3fe52f72d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:33.493381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 503/1019] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:33.773866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4f8c-f117-42cb-94bf-f5a31c0de482 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:33.775484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-399b4f8c-f117-42cb-94bf-f5a31c0de482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:33.827917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:33.886828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4f8c-f117-42cb-94bf-f5a31c0de482 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:33.965716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9666673-c62c-48b4-a0c7-c0bf2e8105e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:33.966349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9666673-c62c-48b4-a0c7-c0bf2e8105e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:33.966566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9666673-c62c-48b4-a0c7-c0bf2e8105e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:33.966864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9666673-c62c-48b4-a0c7-c0bf2e8105e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:33.968497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a9666673-c62c-48b4-a0c7-c0bf2e8105e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:34.063346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:34.080888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9666673-c62c-48b4-a0c7-c0bf2e8105e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:34.082345 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9666673-c62c-48b4-a0c7-c0bf2e8105e7 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:34.101625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 517/1020] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:36.919142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2121-5ab8-47cb-8e6c-d332bdf72b4f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:36.919676 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2121-5ab8-47cb-8e6c-d332bdf72b4f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:36.919676 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2121-5ab8-47cb-8e6c-d332bdf72b4f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:36.921232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 504/1021] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:36.926712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4f659-6543-4a05-9be7-8fe6c94ed92b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:36.927179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4f659-6543-4a05-9be7-8fe6c94ed92b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:36.927272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4f659-6543-4a05-9be7-8fe6c94ed92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:36.997316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-14c4f659-6543-4a05-9be7-8fe6c94ed92b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:36.998502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-14c4f659-6543-4a05-9be7-8fe6c94ed92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:37.104977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 518/1022] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:37.388370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db2121-5ab8-47cb-8e6c-d332bdf72b4f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:37.390741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d8db2121-5ab8-47cb-8e6c-d332bdf72b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:37.484631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:37.503082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db2121-5ab8-47cb-8e6c-d332bdf72b4f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:37.579073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccef082-4fcb-41f0-b404-82dff8fd49f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:37.579686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccef082-4fcb-41f0-b404-82dff8fd49f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:37.579995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccef082-4fcb-41f0-b404-82dff8fd49f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:37.580260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccef082-4fcb-41f0-b404-82dff8fd49f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:37.581990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8ccef082-4fcb-41f0-b404-82dff8fd49f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:37.692242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccef082-4fcb-41f0-b404-82dff8fd49f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:37.693678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccef082-4fcb-41f0-b404-82dff8fd49f1 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:37.711608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 505/1023] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:42.498464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56378a-b557-491b-a9f5-3fc77c316e15 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:42.499079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56378a-b557-491b-a9f5-3fc77c316e15 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:42.499079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56378a-b557-491b-a9f5-3fc77c316e15 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:42.500377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 519/1024] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:34:42.505874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f98c-b385-429c-833a-46546ce59cc8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:42.506332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f98c-b385-429c-833a-46546ce59cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:42.506428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f98c-b385-429c-833a-46546ce59cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:42.522660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:42.573490 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fdf7f98c-b385-429c-833a-46546ce59cc8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:42.574691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fdf7f98c-b385-429c-833a-46546ce59cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:42.682280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 506/1025] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:42.961119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56378a-b557-491b-a9f5-3fc77c316e15 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:42.962664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8e56378a-b557-491b-a9f5-3fc77c316e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:43.036422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:43.084969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56378a-b557-491b-a9f5-3fc77c316e15 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:43.160347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71f764-6659-4687-aa94-7a8a9c355a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:43.160957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71f764-6659-4687-aa94-7a8a9c355a3d service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:43.161291 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71f764-6659-4687-aa94-7a8a9c355a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:43.161958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71f764-6659-4687-aa94-7a8a9c355a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:43.163173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ea71f764-6659-4687-aa94-7a8a9c355a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:43.269718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:43.273323 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71f764-6659-4687-aa94-7a8a9c355a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:43.274802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71f764-6659-4687-aa94-7a8a9c355a3d service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:43.292739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 520/1026] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:34:48.198987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38974e3-43ea-4d54-9346-7bb6e3ef7734 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:48.199866 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38974e3-43ea-4d54-9346-7bb6e3ef7734 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:48.200336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38974e3-43ea-4d54-9346-7bb6e3ef7734 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:48.202357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 507/1027] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:48.207482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d5132-d964-42d3-927f-eef35807157c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:48.207906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d5132-d964-42d3-927f-eef35807157c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:48.208028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d5132-d964-42d3-927f-eef35807157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:48.314758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5a8d5132-d964-42d3-927f-eef35807157c None None] MFA Rules not processed for user `0f040c31c0d4439594404739d44a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:48.316201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5a8d5132-d964-42d3-927f-eef35807157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:48.495695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 521/1028] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:34:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:34:52.622313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ce83-f8be-483a-a687-4bc5c0065ef4 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:52.623266 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ce83-f8be-483a-a687-4bc5c0065ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:52.623505 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ce83-f8be-483a-a687-4bc5c0065ef4 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:52.625002 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 508/1029] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:52.630165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa103a36-ad52-482a-bf75-57c2da93e031 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:52.630585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa103a36-ad52-482a-bf75-57c2da93e031 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:52.630910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa103a36-ad52-482a-bf75-57c2da93e031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:52.680475 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=59 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:52.694748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:52.723692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fa103a36-ad52-482a-bf75-57c2da93e031 None None] MFA Rules not processed for user `0f040c31c0d4439594404739d44a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:52.725292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fa103a36-ad52-482a-bf75-57c2da93e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:52.845790 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 522/1030] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:34:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:54.077242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390bd0a-3fff-4944-b930-11184c5559a8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:54.077811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390bd0a-3fff-4944-b930-11184c5559a8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:54.077811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390bd0a-3fff-4944-b930-11184c5559a8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:54.079171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 509/1031] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:54.084702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311831c7-4fb3-403a-8083-5de146e21a8a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:54.085160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311831c7-4fb3-403a-8083-5de146e21a8a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:54.085464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311831c7-4fb3-403a-8083-5de146e21a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:54.166763 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-311831c7-4fb3-403a-8083-5de146e21a8a None None] MFA Rules not processed for user `0f040c31c0d4439594404739d44a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:54.168013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-311831c7-4fb3-403a-8083-5de146e21a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:54.209644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:54.275954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 523/1032] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:34:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:34:57.920616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124fa19-0538-40fd-a457-b7ed6cca947b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:57.921177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124fa19-0538-40fd-a457-b7ed6cca947b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:57.921177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124fa19-0538-40fd-a457-b7ed6cca947b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:57.922351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 510/1033] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:57.927847 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234db63-650e-4b6f-825e-6e94848fe954 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:57.928344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234db63-650e-4b6f-825e-6e94848fe954 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:57.928541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234db63-650e-4b6f-825e-6e94848fe954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:57.999600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c234db63-650e-4b6f-825e-6e94848fe954 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:58.000683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c234db63-650e-4b6f-825e-6e94848fe954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:58.108600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 524/1034] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:58.406411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b875d-9e82-4d97-a2fe-1e125cae427d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:58.406851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b875d-9e82-4d97-a2fe-1e125cae427d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:58.408009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b875d-9e82-4d97-a2fe-1e125cae427d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:58.409620 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 511/1035] 10.222.0.46 () {54 vars in 961 bytes} [Mon Oct 24 13:34:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:34:58.420488 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc50abd-a799-4eb3-8f42-e5bfc34c45fa None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:58.421439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc50abd-a799-4eb3-8f42-e5bfc34c45fa None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:58.421806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc50abd-a799-4eb3-8f42-e5bfc34c45fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:58.443108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:58.512071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-afc50abd-a799-4eb3-8f42-e5bfc34c45fa None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:34:58.513398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-afc50abd-a799-4eb3-8f42-e5bfc34c45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:58.640927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 525/1036] 10.222.0.46 () {58 vars in 1058 bytes} [Mon Oct 24 13:34:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:34:58.649649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b875d-9e82-4d97-a2fe-1e125cae427d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:34:58.651278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-488b875d-9e82-4d97-a2fe-1e125cae427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:58.808709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b875d-9e82-4d97-a2fe-1e125cae427d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:34:58.888497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:58.933523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f325e45-c76d-4975-b5ad-25c355e2c108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:34:58.934223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f325e45-c76d-4975-b5ad-25c355e2c108 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:34:58.934329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f325e45-c76d-4975-b5ad-25c355e2c108 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:34:58.934640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f325e45-c76d-4975-b5ad-25c355e2c108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:34:58.936210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9f325e45-c76d-4975-b5ad-25c355e2c108 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:34:59.034312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f325e45-c76d-4975-b5ad-25c355e2c108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:34:59.035937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f325e45-c76d-4975-b5ad-25c355e2c108 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:34:59.055719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 512/1037] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:01.439203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137ccd0-9dcb-483f-8201-33d8afd184b4 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:01.439699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137ccd0-9dcb-483f-8201-33d8afd184b4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:01.439793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137ccd0-9dcb-483f-8201-33d8afd184b4 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:01.443302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 526/1038] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:01.447058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0dd75-4b6d-458a-a747-36cb27033ed1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:01.447626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0dd75-4b6d-458a-a747-36cb27033ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:01.447990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0dd75-4b6d-458a-a747-36cb27033ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:01.516421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-89a0dd75-4b6d-458a-a747-36cb27033ed1 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:01.517989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-89a0dd75-4b6d-458a-a747-36cb27033ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:01.557899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:01.622778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 513/1039] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:01.917057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137ccd0-9dcb-483f-8201-33d8afd184b4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:01.918663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2137ccd0-9dcb-483f-8201-33d8afd184b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:01.999751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:02.096814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137ccd0-9dcb-483f-8201-33d8afd184b4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:02.217817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591919-3d16-40d4-b628-c22b09add975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:02.218435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591919-3d16-40d4-b628-c22b09add975 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:02.218710 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591919-3d16-40d4-b628-c22b09add975 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:02.219009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591919-3d16-40d4-b628-c22b09add975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:02.220646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d3591919-3d16-40d4-b628-c22b09add975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:02.244341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:02.313365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591919-3d16-40d4-b628-c22b09add975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:02.315023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591919-3d16-40d4-b628-c22b09add975 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:02.333502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 527/1040] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:04.811066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b3e8-8852-4ee4-a9d8-7ef29248e6fb None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:04.811621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b3e8-8852-4ee4-a9d8-7ef29248e6fb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:04.811621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b3e8-8852-4ee4-a9d8-7ef29248e6fb None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:04.813116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 514/1041] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:04.818398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19102c1a-7275-4e5d-85b6-3e89fbe9132e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:04.818843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19102c1a-7275-4e5d-85b6-3e89fbe9132e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:04.818994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19102c1a-7275-4e5d-85b6-3e89fbe9132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:04.887445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-19102c1a-7275-4e5d-85b6-3e89fbe9132e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:04.888930 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-19102c1a-7275-4e5d-85b6-3e89fbe9132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:04.989749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:04.992177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 528/1042] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:05.284660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f2eb8-eb3e-4fa4-b614-170002e89bc9 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:05.285055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f2eb8-eb3e-4fa4-b614-170002e89bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:05.285413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f2eb8-eb3e-4fa4-b614-170002e89bc9 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:05.287129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 515/1043] 10.222.0.46 () {54 vars in 961 bytes} [Mon Oct 24 13:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:05.293123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d37f5f-5cf2-4a18-9268-e9b28be0451a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:05.293377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d37f5f-5cf2-4a18-9268-e9b28be0451a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:05.293686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d37f5f-5cf2-4a18-9268-e9b28be0451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:05.375444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-19d37f5f-5cf2-4a18-9268-e9b28be0451a None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:05.377049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-19d37f5f-5cf2-4a18-9268-e9b28be0451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:05.502849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 529/1044] 10.222.0.46 () {58 vars in 1058 bytes} [Mon Oct 24 13:35:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:05.512139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f2eb8-eb3e-4fa4-b614-170002e89bc9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:05.513753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2f8f2eb8-eb3e-4fa4-b614-170002e89bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:05.674823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f2eb8-eb3e-4fa4-b614-170002e89bc9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:05.701115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:05.802772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2990ba-ad84-48af-9de3-e55f17116dee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:05.803466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2990ba-ad84-48af-9de3-e55f17116dee service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:05.803762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2990ba-ad84-48af-9de3-e55f17116dee service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:05.804019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2990ba-ad84-48af-9de3-e55f17116dee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:05.805640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bf2990ba-ad84-48af-9de3-e55f17116dee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:05.906863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2990ba-ad84-48af-9de3-e55f17116dee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:05.908510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2990ba-ad84-48af-9de3-e55f17116dee service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:05.927957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 516/1045] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:05.941766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d95b0-20c0-4362-8436-de092bcae1cf None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:05.942222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d95b0-20c0-4362-8436-de092bcae1cf None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:05.942302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d95b0-20c0-4362-8436-de092bcae1cf None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:05.943923 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 530/1046] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:05.949580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c6232-2906-4924-a372-647aa58f4584 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:05.949850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c6232-2906-4924-a372-647aa58f4584 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:05.950122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c6232-2906-4924-a372-647aa58f4584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:05.988524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:06.028990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3c5c6232-2906-4924-a372-647aa58f4584 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:06.030204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3c5c6232-2906-4924-a372-647aa58f4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:06.159000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 517/1047] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:06.493888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342db6c-ccb0-46d6-8d89-c8b60ada9b48 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:06.494293 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342db6c-ccb0-46d6-8d89-c8b60ada9b48 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:06.494874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342db6c-ccb0-46d6-8d89-c8b60ada9b48 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:06.496359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 531/1048] 10.222.0.46 () {54 vars in 963 bytes} [Mon Oct 24 13:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:06.501871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e036e50-52d5-4d61-9c83-c1158c8c8a05 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:06.502155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e036e50-52d5-4d61-9c83-c1158c8c8a05 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:06.502424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e036e50-52d5-4d61-9c83-c1158c8c8a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:06.583063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2e036e50-52d5-4d61-9c83-c1158c8c8a05 None None] MFA Rules not processed for user `37c812964d514d3f8082f90d0f512246`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:06.584250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2e036e50-52d5-4d61-9c83-c1158c8c8a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:06.633237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:06.666197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 518/1049] 10.222.0.46 () {58 vars in 1060 bytes} [Mon Oct 24 13:35:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:06.674285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342db6c-ccb0-46d6-8d89-c8b60ada9b48 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:06.675850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c342db6c-ccb0-46d6-8d89-c8b60ada9b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:06.734947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:06.793320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342db6c-ccb0-46d6-8d89-c8b60ada9b48 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:06.874161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c543fd-91f3-4017-8544-d09c9c9d6cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:06.874896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c543fd-91f3-4017-8544-d09c9c9d6cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:06.875160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c543fd-91f3-4017-8544-d09c9c9d6cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:06.875447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c543fd-91f3-4017-8544-d09c9c9d6cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:06.877100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e4c543fd-91f3-4017-8544-d09c9c9d6cc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:06.986384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:07.002417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c543fd-91f3-4017-8544-d09c9c9d6cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:07.003906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c543fd-91f3-4017-8544-d09c9c9d6cc3 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:07.024158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 532/1050] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:08.186941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6342-3077-41d3-8de4-ee82effc9920 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:08.187487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6342-3077-41d3-8de4-ee82effc9920 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:08.187487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6342-3077-41d3-8de4-ee82effc9920 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:08.189022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 519/1051] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:08.195876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241fbe-2655-4456-aa55-28fd5eb81339 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:08.196356 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241fbe-2655-4456-aa55-28fd5eb81339 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:08.196538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241fbe-2655-4456-aa55-28fd5eb81339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:08.266881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b1241fbe-2655-4456-aa55-28fd5eb81339 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:08.268472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b1241fbe-2655-4456-aa55-28fd5eb81339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:08.370502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 533/1052] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:08.663770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6342-3077-41d3-8de4-ee82effc9920 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:08.665427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f8ee6342-3077-41d3-8de4-ee82effc9920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:08.812071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6342-3077-41d3-8de4-ee82effc9920 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:08.863888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:08.928929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d503561-c302-4d29-94ff-0bc047601244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:08.929643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d503561-c302-4d29-94ff-0bc047601244 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:08.929914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d503561-c302-4d29-94ff-0bc047601244 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:08.930176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d503561-c302-4d29-94ff-0bc047601244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:08.931872 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4d503561-c302-4d29-94ff-0bc047601244 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:09.026060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d503561-c302-4d29-94ff-0bc047601244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:09.034007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d503561-c302-4d29-94ff-0bc047601244 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:09.046578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 520/1053] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:11.256136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065e15b-9644-4bee-bb1a-7abfc4af836e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:11.256757 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065e15b-9644-4bee-bb1a-7abfc4af836e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:11.256757 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065e15b-9644-4bee-bb1a-7abfc4af836e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:11.258040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 534/1054] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:11.263552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae1a2-3ce5-4e3d-bb40-eebf1281b2d6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:11.264062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae1a2-3ce5-4e3d-bb40-eebf1281b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:11.264062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae1a2-3ce5-4e3d-bb40-eebf1281b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:11.337586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c22ae1a2-3ce5-4e3d-bb40-eebf1281b2d6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:11.338773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c22ae1a2-3ce5-4e3d-bb40-eebf1281b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:11.345641 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:11.451116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 521/1055] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:11.733018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065e15b-9644-4bee-bb1a-7abfc4af836e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:11.734543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3065e15b-9644-4bee-bb1a-7abfc4af836e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:11.799737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:11.891492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065e15b-9644-4bee-bb1a-7abfc4af836e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:12.008873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806145a-c4b5-45ee-b1f0-2fa4368c8aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:12.009390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806145a-c4b5-45ee-b1f0-2fa4368c8aaa service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:12.009666 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806145a-c4b5-45ee-b1f0-2fa4368c8aaa service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:12.009932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806145a-c4b5-45ee-b1f0-2fa4368c8aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:12.011532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7806145a-c4b5-45ee-b1f0-2fa4368c8aaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:12.031621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:12.109108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806145a-c4b5-45ee-b1f0-2fa4368c8aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:12.110722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806145a-c4b5-45ee-b1f0-2fa4368c8aaa service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:12.132810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 535/1056] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:14.357929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca188538-fbff-4773-8d5f-b07ae680156f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:14.358396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca188538-fbff-4773-8d5f-b07ae680156f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:14.358586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca188538-fbff-4773-8d5f-b07ae680156f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:14.359815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 522/1057] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:14.373092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99710-5238-4b6d-9018-86fd64194ae4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:14.373672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99710-5238-4b6d-9018-86fd64194ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:14.373953 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99710-5238-4b6d-9018-86fd64194ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:14.488418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-aba99710-5238-4b6d-9018-86fd64194ae4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:14.489640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-aba99710-5238-4b6d-9018-86fd64194ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:14.584347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:14.590707 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 536/1058] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:14.976528 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca188538-fbff-4773-8d5f-b07ae680156f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:14.978238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ca188538-fbff-4773-8d5f-b07ae680156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:15.127589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:15.138697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca188538-fbff-4773-8d5f-b07ae680156f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:15.259806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e9553-1741-4ee0-b301-99fc3e06c822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:15.260325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e9553-1741-4ee0-b301-99fc3e06c822 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:15.260595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e9553-1741-4ee0-b301-99fc3e06c822 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:15.260858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e9553-1741-4ee0-b301-99fc3e06c822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:15.262456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1c2e9553-1741-4ee0-b301-99fc3e06c822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:15.357844 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e9553-1741-4ee0-b301-99fc3e06c822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:15.359479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e9553-1741-4ee0-b301-99fc3e06c822 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:15.370262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:15.380558 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 523/1059] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:17.660412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f31398-280b-478c-9975-c04f3766afb2 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:17.661318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f31398-280b-478c-9975-c04f3766afb2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:17.661318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f31398-280b-478c-9975-c04f3766afb2 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:17.662328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 537/1060] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:17.668375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162bac-c197-4405-a81a-ea81ba31f150 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:17.668854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162bac-c197-4405-a81a-ea81ba31f150 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:17.668959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162bac-c197-4405-a81a-ea81ba31f150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:17.748392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-47162bac-c197-4405-a81a-ea81ba31f150 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:17.750051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-47162bac-c197-4405-a81a-ea81ba31f150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:17.878511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 524/1061] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:18.176815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f31398-280b-478c-9975-c04f3766afb2 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:18.179354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b0f31398-280b-478c-9975-c04f3766afb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:18.354670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f31398-280b-478c-9975-c04f3766afb2 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:18.426436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:18.480202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e211b-ba77-4b53-b679-78ba0c983002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:18.480845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e211b-ba77-4b53-b679-78ba0c983002 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:18.481164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e211b-ba77-4b53-b679-78ba0c983002 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:18.481454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e211b-ba77-4b53-b679-78ba0c983002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:18.483154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-974e211b-ba77-4b53-b679-78ba0c983002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:18.595511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e211b-ba77-4b53-b679-78ba0c983002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:18.597302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e211b-ba77-4b53-b679-78ba0c983002 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:18.621755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 538/1062] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:20.907675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089ca02-3bcb-4131-bde4-2cc2908e1f21 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:20.908289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089ca02-3bcb-4131-bde4-2cc2908e1f21 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:20.908289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089ca02-3bcb-4131-bde4-2cc2908e1f21 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:20.909536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 525/1063] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:20.915167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4942450-bfe9-46e8-80dd-bec32ed5b962 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:20.915647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4942450-bfe9-46e8-80dd-bec32ed5b962 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:20.915647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4942450-bfe9-46e8-80dd-bec32ed5b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:20.985051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c4942450-bfe9-46e8-80dd-bec32ed5b962 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:20.986250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c4942450-bfe9-46e8-80dd-bec32ed5b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:21.019800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:21.083210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 539/1064] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:21.370766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089ca02-3bcb-4131-bde4-2cc2908e1f21 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:21.372367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3089ca02-3bcb-4131-bde4-2cc2908e1f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:21.453317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:21.524020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089ca02-3bcb-4131-bde4-2cc2908e1f21 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:21.639304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77d072-2243-4ab7-807f-0ffdc640f021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:21.639802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d072-2243-4ab7-807f-0ffdc640f021 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:21.640069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d072-2243-4ab7-807f-0ffdc640f021 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:21.640333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d072-2243-4ab7-807f-0ffdc640f021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:21.641935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fd77d072-2243-4ab7-807f-0ffdc640f021 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:21.682586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:21.736541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77d072-2243-4ab7-807f-0ffdc640f021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:21.738122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77d072-2243-4ab7-807f-0ffdc640f021 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:21.756208 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 526/1065] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:22.657238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9452317-4322-4daa-9a0d-dc9823dd48f3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:22.658285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9452317-4322-4daa-9a0d-dc9823dd48f3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:22.658631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9452317-4322-4daa-9a0d-dc9823dd48f3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:22.660296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 540/1066] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:22.665705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c79e49-4a75-4a9b-82c9-73c72601c80c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:22.666210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c79e49-4a75-4a9b-82c9-73c72601c80c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:22.666338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c79e49-4a75-4a9b-82c9-73c72601c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:22.738953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-06c79e49-4a75-4a9b-82c9-73c72601c80c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:22.740160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-06c79e49-4a75-4a9b-82c9-73c72601c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:22.838738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 527/1067] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:35:23.140855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc355b-ac8c-4c04-ae95-c9aa16f5f550 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:23.141464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc355b-ac8c-4c04-ae95-c9aa16f5f550 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:23.141951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc355b-ac8c-4c04-ae95-c9aa16f5f550 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:23.144356 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 541/1068] 10.222.0.46 () {54 vars in 962 bytes} [Mon Oct 24 13:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:23.149603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb4c6a-f6d1-4569-8c1c-bb527129480e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:23.150105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb4c6a-f6d1-4569-8c1c-bb527129480e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:23.150594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb4c6a-f6d1-4569-8c1c-bb527129480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:23.167963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:23.233997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-47bb4c6a-f6d1-4569-8c1c-bb527129480e None None] MFA Rules not processed for user `68d8ec9210f54c6698477d7dbbe46a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:23.235637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-47bb4c6a-f6d1-4569-8c1c-bb527129480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:23.317703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 528/1069] 10.222.0.46 () {58 vars in 1059 bytes} [Mon Oct 24 13:35:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:23.325955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc355b-ac8c-4c04-ae95-c9aa16f5f550 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:23.327535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2bcc355b-ac8c-4c04-ae95-c9aa16f5f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:23.436634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc355b-ac8c-4c04-ae95-c9aa16f5f550 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:23.497513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:23.513857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c9985-7fa0-4729-9809-a7afba92c7a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8ec9210f54c6698477d7dbbe46a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:23.514469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c9985-7fa0-4729-9809-a7afba92c7a4 service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:23.514739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c9985-7fa0-4729-9809-a7afba92c7a4 service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:23.515037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c9985-7fa0-4729-9809-a7afba92c7a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:23.516599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-666c9985-7fa0-4729-9809-a7afba92c7a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:23.628140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c9985-7fa0-4729-9809-a7afba92c7a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:23.629658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c9985-7fa0-4729-9809-a7afba92c7a4 service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:23.649426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 542/1070] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:23.938043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80738e1-5269-45fc-a20e-c0168bcf4288 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:23.938563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80738e1-5269-45fc-a20e-c0168bcf4288 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:23.938563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80738e1-5269-45fc-a20e-c0168bcf4288 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:23.940162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 529/1071] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:23.945652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744693-c69f-457f-bdc4-57612e88f263 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:23.946117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744693-c69f-457f-bdc4-57612e88f263 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:23.946214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744693-c69f-457f-bdc4-57612e88f263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:24.020575 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-98744693-c69f-457f-bdc4-57612e88f263 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:24.021991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-98744693-c69f-457f-bdc4-57612e88f263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:24.069187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:24.132165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 543/1072] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:24.400827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f618cb-7eed-4cfb-82c8-a5b9798f27e3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:24.401179 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f618cb-7eed-4cfb-82c8-a5b9798f27e3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:24.401668 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f618cb-7eed-4cfb-82c8-a5b9798f27e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:24.420197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98744693-c69f-457f-bdc4-57612e88f263 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:24.421341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-98744693-c69f-457f-bdc4-57612e88f263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:24.472968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-55f618cb-7eed-4cfb-82c8-a5b9798f27e3 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:24.474184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-55f618cb-7eed-4cfb-82c8-a5b9798f27e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:24.531747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:24.538495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98744693-c69f-457f-bdc4-57612e88f263 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:24.563758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 530/1073] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:35:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:24.595662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:24.609609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad72585-c667-4ea9-9869-8a1fe1af0a67 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:24.609879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad72585-c667-4ea9-9869-8a1fe1af0a67 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:24.610137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad72585-c667-4ea9-9869-8a1fe1af0a67 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:24.611563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 531/1074] 10.222.0.46 () {54 vars in 943 bytes} [Mon Oct 24 13:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:35:24.617664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722990ef-835d-479e-96f2-ef9f202435a4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:24.617936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722990ef-835d-479e-96f2-ef9f202435a4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:24.618205 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722990ef-835d-479e-96f2-ef9f202435a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:24.655573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465a682-b566-4248-86c7-90baca985dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:24.656182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465a682-b566-4248-86c7-90baca985dff service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:24.656448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465a682-b566-4248-86c7-90baca985dff service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:24.656709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465a682-b566-4248-86c7-90baca985dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:24.658287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1465a682-b566-4248-86c7-90baca985dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:24.694418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-722990ef-835d-479e-96f2-ef9f202435a4 None None] MFA Rules not processed for user `28110c7825734d229ac61878eacbe49e`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:24.695638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-722990ef-835d-479e-96f2-ef9f202435a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:24.751505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465a682-b566-4248-86c7-90baca985dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:24.753116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465a682-b566-4248-86c7-90baca985dff service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:24.771684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 544/1075] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:35:24.801860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 532/1076] 10.222.0.46 () {58 vars in 1040 bytes} [Mon Oct 24 13:35:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:35:24.811292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465a682-b566-4248-86c7-90baca985dff service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:24.812528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1465a682-b566-4248-86c7-90baca985dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:24.881178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:24.911917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465a682-b566-4248-86c7-90baca985dff service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:25.028487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6c014-d7d6-402d-a56c-9c561ac3a460 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:25.029161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6c014-d7d6-402d-a56c-9c561ac3a460 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:25.029260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6c014-d7d6-402d-a56c-9c561ac3a460 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:25.029519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6c014-d7d6-402d-a56c-9c561ac3a460 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:25.031142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-26a6c014-d7d6-402d-a56c-9c561ac3a460 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:25.120051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6c014-d7d6-402d-a56c-9c561ac3a460 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:25.121342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6c014-d7d6-402d-a56c-9c561ac3a460 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:25.151423 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 545/1077] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:35:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:35:27.036214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0262-a38b-4e45-85e3-a5d48284603e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:27.036830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0262-a38b-4e45-85e3-a5d48284603e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:27.036830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0262-a38b-4e45-85e3-a5d48284603e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:27.038090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 533/1078] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:27.044051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890922b-966b-4c3d-877c-973f69d6e697 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:27.044606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890922b-966b-4c3d-877c-973f69d6e697 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:27.044606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890922b-966b-4c3d-877c-973f69d6e697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:27.062564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:27.128343 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4890922b-966b-4c3d-877c-973f69d6e697 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:27.130197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4890922b-966b-4c3d-877c-973f69d6e697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:27.249011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 546/1079] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:27.546633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0262-a38b-4e45-85e3-a5d48284603e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:27.548991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-676c0262-a38b-4e45-85e3-a5d48284603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:27.586877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:27.721174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0262-a38b-4e45-85e3-a5d48284603e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:27.829878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:27.841086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3a7e0-e12e-4e1a-8eee-09e2fab26407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:27.841783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3a7e0-e12e-4e1a-8eee-09e2fab26407 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:27.842139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3a7e0-e12e-4e1a-8eee-09e2fab26407 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:27.842469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3a7e0-e12e-4e1a-8eee-09e2fab26407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:27.844170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-98a3a7e0-e12e-4e1a-8eee-09e2fab26407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:27.948811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3a7e0-e12e-4e1a-8eee-09e2fab26407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:27.950392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3a7e0-e12e-4e1a-8eee-09e2fab26407 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:27.968889 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 534/1080] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:30.161317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aae48-c5fe-4408-a4e6-9dfcd9f56033 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:30.161879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aae48-c5fe-4408-a4e6-9dfcd9f56033 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:30.161879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aae48-c5fe-4408-a4e6-9dfcd9f56033 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:30.167257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 547/1081] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:30.168805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c0a89-18e5-4a91-b8d6-73e90043a5a8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:30.169224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c0a89-18e5-4a91-b8d6-73e90043a5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:30.169586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c0a89-18e5-4a91-b8d6-73e90043a5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:30.241601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2f3c0a89-18e5-4a91-b8d6-73e90043a5a8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:30.242891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2f3c0a89-18e5-4a91-b8d6-73e90043a5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:30.309696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:30.363188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 535/1082] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:35:30.653123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aae48-c5fe-4408-a4e6-9dfcd9f56033 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:30.654658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-533aae48-c5fe-4408-a4e6-9dfcd9f56033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:30.750715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:30.815237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aae48-c5fe-4408-a4e6-9dfcd9f56033 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:30.938267 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05163e1f-1d20-4647-9839-6c136be5d8dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:30.938778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05163e1f-1d20-4647-9839-6c136be5d8dc service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:30.939080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05163e1f-1d20-4647-9839-6c136be5d8dc service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:30.939345 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05163e1f-1d20-4647-9839-6c136be5d8dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:30.942534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-05163e1f-1d20-4647-9839-6c136be5d8dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:30.999117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:31.038795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05163e1f-1d20-4647-9839-6c136be5d8dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:31.040450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05163e1f-1d20-4647-9839-6c136be5d8dc service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:31.062603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 548/1083] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:33.333268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92901a-a41f-481f-b90e-7d6361021bcb None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:33.333861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92901a-a41f-481f-b90e-7d6361021bcb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:33.333861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92901a-a41f-481f-b90e-7d6361021bcb None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:33.336590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 536/1084] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:33.341199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914769b-998f-41a0-85bd-8820d11cdeae None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:33.341628 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914769b-998f-41a0-85bd-8820d11cdeae None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:33.341720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914769b-998f-41a0-85bd-8820d11cdeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:33.425721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2914769b-998f-41a0-85bd-8820d11cdeae None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:33.427745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2914769b-998f-41a0-85bd-8820d11cdeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:33.537768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 549/1085] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:33.822731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92901a-a41f-481f-b90e-7d6361021bcb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:33.824291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7e92901a-a41f-481f-b90e-7d6361021bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:33.988477 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92901a-a41f-481f-b90e-7d6361021bcb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:34.052006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:34.122380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3955ccc-9444-460b-aefb-df14e70ae2e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:34.123045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955ccc-9444-460b-aefb-df14e70ae2e0 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:34.123375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955ccc-9444-460b-aefb-df14e70ae2e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:34.123888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955ccc-9444-460b-aefb-df14e70ae2e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:34.125483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d3955ccc-9444-460b-aefb-df14e70ae2e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:34.227542 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3955ccc-9444-460b-aefb-df14e70ae2e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:34.229216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3955ccc-9444-460b-aefb-df14e70ae2e0 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:34.250597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 537/1086] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:43.536268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=87 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:44.248433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=76 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:48.065288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b683d-6416-4671-b3b3-7ea58130fdb9 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:48.065885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b683d-6416-4671-b3b3-7ea58130fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:48.065885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b683d-6416-4671-b3b3-7ea58130fdb9 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:48.067531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 550/1087] 10.222.0.46 () {54 vars in 918 bytes} [Mon Oct 24 13:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:48.073052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fc8c8-05f3-49b8-8c44-31002e4dd5e0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:48.073496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fc8c8-05f3-49b8-8c44-31002e4dd5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:48.073597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fc8c8-05f3-49b8-8c44-31002e4dd5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:48.153766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-068fc8c8-05f3-49b8-8c44-31002e4dd5e0 None None] MFA Rules not processed for user `0f040c31c0d4439594404739d44a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:48.154266 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-068fc8c8-05f3-49b8-8c44-31002e4dd5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:48.273199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 538/1088] 10.222.0.46 () {58 vars in 1015 bytes} [Mon Oct 24 13:35:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:48.293338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a114b5-00b1-44dd-97e1-fdb9aa18a544 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:48.293616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a114b5-00b1-44dd-97e1-fdb9aa18a544 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:48.293879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a114b5-00b1-44dd-97e1-fdb9aa18a544 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:48.295287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 551/1089] 10.222.0.46 () {54 vars in 918 bytes} [Mon Oct 24 13:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:48.300149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5162f-b8e9-4404-8c6f-01689e1200b8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:48.300438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5162f-b8e9-4404-8c6f-01689e1200b8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:48.300708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5162f-b8e9-4404-8c6f-01689e1200b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:48.381211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:48.382799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-daa5162f-b8e9-4404-8c6f-01689e1200b8 None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:48.384315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-daa5162f-b8e9-4404-8c6f-01689e1200b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:48.510910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 539/1090] 10.222.0.46 () {58 vars in 1015 bytes} [Mon Oct 24 13:35:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:51.092383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57aaa8-205b-43df-8575-9acfd1d5d5cb None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:51.092973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57aaa8-205b-43df-8575-9acfd1d5d5cb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:51.092973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57aaa8-205b-43df-8575-9acfd1d5d5cb None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:51.094971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 552/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:51.104282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7804572-1b28-484b-8594-fa7ea651022e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:51.105070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7804572-1b28-484b-8594-fa7ea651022e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:51.105243 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7804572-1b28-484b-8594-fa7ea651022e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:51.180801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c7804572-1b28-484b-8594-fa7ea651022e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:51.182015 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c7804572-1b28-484b-8594-fa7ea651022e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:51.248005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:51.293644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 540/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:51.591011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57aaa8-205b-43df-8575-9acfd1d5d5cb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:51.592701 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2e57aaa8-205b-43df-8575-9acfd1d5d5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:51.752199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57aaa8-205b-43df-8575-9acfd1d5d5cb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:51.832597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:51.878033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d9210-af5f-4ffb-a754-3412644ed119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:51.878643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d9210-af5f-4ffb-a754-3412644ed119 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:51.878917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d9210-af5f-4ffb-a754-3412644ed119 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:51.879211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d9210-af5f-4ffb-a754-3412644ed119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:51.880806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-499d9210-af5f-4ffb-a754-3412644ed119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:51.975473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d9210-af5f-4ffb-a754-3412644ed119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:51.977073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d9210-af5f-4ffb-a754-3412644ed119 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:51.996633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 553/1093] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:53.140992 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2321370-66da-4673-85d1-b4ec7c135874 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:53.141631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2321370-66da-4673-85d1-b4ec7c135874 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:53.141631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2321370-66da-4673-85d1-b4ec7c135874 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:53.142856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 541/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:53.149390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d4dd-f620-4ddc-9da6-a5e3122197d2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:53.150042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d4dd-f620-4ddc-9da6-a5e3122197d2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:53.150136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d4dd-f620-4ddc-9da6-a5e3122197d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:53.231102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-aa04d4dd-f620-4ddc-9da6-a5e3122197d2 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:53.232308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-aa04d4dd-f620-4ddc-9da6-a5e3122197d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:53.261210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:53.337934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 554/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:53.506163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2321370-66da-4673-85d1-b4ec7c135874 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:53.507672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a2321370-66da-4673-85d1-b4ec7c135874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:53.684186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2321370-66da-4673-85d1-b4ec7c135874 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:53.728991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:53.804736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e8a83-5f4b-47bb-862c-6a8751bd3ae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:53.805339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e8a83-5f4b-47bb-862c-6a8751bd3ae1 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:53.805603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e8a83-5f4b-47bb-862c-6a8751bd3ae1 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:53.805901 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e8a83-5f4b-47bb-862c-6a8751bd3ae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:53.807532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-af3e8a83-5f4b-47bb-862c-6a8751bd3ae1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:53.916321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e8a83-5f4b-47bb-862c-6a8751bd3ae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:53.917895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e8a83-5f4b-47bb-862c-6a8751bd3ae1 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:53.936864 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 542/1096] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:55.050675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c093f7-220f-42a1-9f25-75a7d2c73416 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:55.051637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c093f7-220f-42a1-9f25-75a7d2c73416 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:55.051637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c093f7-220f-42a1-9f25-75a7d2c73416 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:55.053689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 555/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:35:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:55.059733 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba8a1e-7f6a-4694-9088-f628597201b4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:55.060174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba8a1e-7f6a-4694-9088-f628597201b4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:55.060447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba8a1e-7f6a-4694-9088-f628597201b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:55.122273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:55.146687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fdba8a1e-7f6a-4694-9088-f628597201b4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:55.147942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fdba8a1e-7f6a-4694-9088-f628597201b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:55.253376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 543/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:55.402418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c093f7-220f-42a1-9f25-75a7d2c73416 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:55.403968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-08c093f7-220f-42a1-9f25-75a7d2c73416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:55.554231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c093f7-220f-42a1-9f25-75a7d2c73416 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:55.567041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:55.671835 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f292d-6b4b-446d-a07f-5263f95b5e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:55.672346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f292d-6b4b-446d-a07f-5263f95b5e51 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:55.672611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f292d-6b4b-446d-a07f-5263f95b5e51 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:55.672874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f292d-6b4b-446d-a07f-5263f95b5e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:55.674444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-766f292d-6b4b-446d-a07f-5263f95b5e51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:55.766942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f292d-6b4b-446d-a07f-5263f95b5e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:55.768889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f292d-6b4b-446d-a07f-5263f95b5e51 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:55.786705 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 556/1099] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:56.885547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f39b48-bbed-42e4-b2a5-522aa7e1f4c4 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:56.886155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f39b48-bbed-42e4-b2a5-522aa7e1f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:56.886155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f39b48-bbed-42e4-b2a5-522aa7e1f4c4 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:56.887469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 544/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:56.893435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f724b-ee81-47be-be0a-9acb511c85a9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:56.894285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f724b-ee81-47be-be0a-9acb511c85a9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:56.894395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f724b-ee81-47be-be0a-9acb511c85a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:56.917935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:56.976562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5b8f724b-ee81-47be-be0a-9acb511c85a9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:56.977817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5b8f724b-ee81-47be-be0a-9acb511c85a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:57.076804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 557/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:57.224743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f39b48-bbed-42e4-b2a5-522aa7e1f4c4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:57.226265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-38f39b48-bbed-42e4-b2a5-522aa7e1f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:57.346138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:57.382601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f39b48-bbed-42e4-b2a5-522aa7e1f4c4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:57.505423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c929f6-78ed-4ff6-bf3d-c00756229552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:57.506021 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c929f6-78ed-4ff6-bf3d-c00756229552 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:57.506286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c929f6-78ed-4ff6-bf3d-c00756229552 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:57.506566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c929f6-78ed-4ff6-bf3d-c00756229552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:57.508161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96c929f6-78ed-4ff6-bf3d-c00756229552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:57.591214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:57.607666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c929f6-78ed-4ff6-bf3d-c00756229552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:57.609262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c929f6-78ed-4ff6-bf3d-c00756229552 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:57.627960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 545/1102] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:58.716295 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20c2c-b271-4316-8942-825bc43cd570 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:58.716892 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20c2c-b271-4316-8942-825bc43cd570 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:58.716892 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20c2c-b271-4316-8942-825bc43cd570 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:58.718797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 558/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:35:58.726063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d7f11-497e-4fdf-a07d-3b6e1425d1f3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:58.726487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d7f11-497e-4fdf-a07d-3b6e1425d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:58.726616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d7f11-497e-4fdf-a07d-3b6e1425d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:58.808457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f27d7f11-497e-4fdf-a07d-3b6e1425d1f3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:35:58.809574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f27d7f11-497e-4fdf-a07d-3b6e1425d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:58.908174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 546/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:35:59.058306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b20c2c-b271-4316-8942-825bc43cd570 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:35:59.059925 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-72b20c2c-b271-4316-8942-825bc43cd570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:59.152273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:59.215690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b20c2c-b271-4316-8942-825bc43cd570 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:35:59.344268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1734c-9830-4152-82ff-086aa6b33a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:35:59.344869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1734c-9830-4152-82ff-086aa6b33a4a service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:35:59.345142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1734c-9830-4152-82ff-086aa6b33a4a service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:35:59.345408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1734c-9830-4152-82ff-086aa6b33a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:35:59.347039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-07e1734c-9830-4152-82ff-086aa6b33a4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:35:59.397979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:59.439671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1734c-9830-4152-82ff-086aa6b33a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:35:59.441270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1734c-9830-4152-82ff-086aa6b33a4a service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:35:59.459476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 559/1105] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:00.522808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f025ed-4894-45c4-aeec-a8b8b1958e47 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:00.523788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f025ed-4894-45c4-aeec-a8b8b1958e47 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:00.523788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f025ed-4894-45c4-aeec-a8b8b1958e47 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:00.525790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 547/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:36:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:00.531674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579146f-4cfe-40b8-94da-4a39a6b19187 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:00.532433 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579146f-4cfe-40b8-94da-4a39a6b19187 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:00.532597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579146f-4cfe-40b8-94da-4a39a6b19187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:00.613989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3579146f-4cfe-40b8-94da-4a39a6b19187 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:00.615151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3579146f-4cfe-40b8-94da-4a39a6b19187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:00.715631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 560/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:00.871787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f025ed-4894-45c4-aeec-a8b8b1958e47 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:00.873282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-15f025ed-4894-45c4-aeec-a8b8b1958e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:00.925036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:01.035543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f025ed-4894-45c4-aeec-a8b8b1958e47 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:01.161405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103e597-7227-4631-8f70-4f596731a05e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:01.161907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103e597-7227-4631-8f70-4f596731a05e service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:01.162205 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103e597-7227-4631-8f70-4f596731a05e service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:01.162466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103e597-7227-4631-8f70-4f596731a05e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:01.164077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0103e597-7227-4631-8f70-4f596731a05e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:01.171146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:01.269070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103e597-7227-4631-8f70-4f596731a05e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:01.270643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103e597-7227-4631-8f70-4f596731a05e service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:01.289724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 548/1108] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:02.320674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7067-e77f-49eb-868c-33768c2926bf None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:02.321505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7067-e77f-49eb-868c-33768c2926bf None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:02.321505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7067-e77f-49eb-868c-33768c2926bf None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:02.323870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 561/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:36:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:02.329958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776d4fa-30b1-4fd4-9f64-7a99a90385df None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:02.330643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776d4fa-30b1-4fd4-9f64-7a99a90385df None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:02.330755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776d4fa-30b1-4fd4-9f64-7a99a90385df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:02.417621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6776d4fa-30b1-4fd4-9f64-7a99a90385df None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:02.418750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6776d4fa-30b1-4fd4-9f64-7a99a90385df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:02.487703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:02.524663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 549/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:02.678127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc7067-e77f-49eb-868c-33768c2926bf None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:02.679590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1fdc7067-e77f-49eb-868c-33768c2926bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:02.698954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:02.842965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc7067-e77f-49eb-868c-33768c2926bf None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:02.945634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:02.972941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa4b2c-1fe5-4e80-ab28-7d3e7aeabfeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:02.973552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa4b2c-1fe5-4e80-ab28-7d3e7aeabfeb service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:02.973827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa4b2c-1fe5-4e80-ab28-7d3e7aeabfeb service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:02.974094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa4b2c-1fe5-4e80-ab28-7d3e7aeabfeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:02.975775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-58fa4b2c-1fe5-4e80-ab28-7d3e7aeabfeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:03.068353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa4b2c-1fe5-4e80-ab28-7d3e7aeabfeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:03.069963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa4b2c-1fe5-4e80-ab28-7d3e7aeabfeb service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:03.088959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 562/1111] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:04.136760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c586e-99e4-4f00-b997-181c77f7534a None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:04.137625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c586e-99e4-4f00-b997-181c77f7534a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:04.137625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c586e-99e4-4f00-b997-181c77f7534a None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:04.139758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 550/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:36:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:04.146057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f26d42-601e-4993-81b1-fe5d8c845455 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:04.146507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f26d42-601e-4993-81b1-fe5d8c845455 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:04.146616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f26d42-601e-4993-81b1-fe5d8c845455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:04.235795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c2f26d42-601e-4993-81b1-fe5d8c845455 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:04.237025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c2f26d42-601e-4993-81b1-fe5d8c845455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:04.286684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:04.343181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 563/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:04.495559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c586e-99e4-4f00-b997-181c77f7534a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:04.497958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-100c586e-99e4-4f00-b997-181c77f7534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:04.664295 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c586e-99e4-4f00-b997-181c77f7534a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:04.725747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:04.790367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113655a7-6cd7-4953-baa6-fe5e60b195ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:04.791043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113655a7-6cd7-4953-baa6-fe5e60b195ff service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:04.791756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113655a7-6cd7-4953-baa6-fe5e60b195ff service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:04.791756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113655a7-6cd7-4953-baa6-fe5e60b195ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:04.793206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-113655a7-6cd7-4953-baa6-fe5e60b195ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:04.894449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113655a7-6cd7-4953-baa6-fe5e60b195ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:04.896085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113655a7-6cd7-4953-baa6-fe5e60b195ff service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:04.914216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 551/1114] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:05.955872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7329841-6c5a-4489-8974-715646a0abe5 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:05.956884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7329841-6c5a-4489-8974-715646a0abe5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:05.956884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7329841-6c5a-4489-8974-715646a0abe5 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:05.958974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 564/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:36:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:05.966974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f43f1-ce4b-4719-80fe-8e2fbe5db379 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:05.967386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f43f1-ce4b-4719-80fe-8e2fbe5db379 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:05.967508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f43f1-ce4b-4719-80fe-8e2fbe5db379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:06.068227 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-340f43f1-ce4b-4719-80fe-8e2fbe5db379 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:06.069431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-340f43f1-ce4b-4719-80fe-8e2fbe5db379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:06.071454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:06.176681 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 552/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:06.329070 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7329841-6c5a-4489-8974-715646a0abe5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:06.330584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b7329841-6c5a-4489-8974-715646a0abe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:06.486724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7329841-6c5a-4489-8974-715646a0abe5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:06.515518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:06.612647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef74027-2c99-4339-be86-12f2be91d962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:06.613329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef74027-2c99-4339-be86-12f2be91d962 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:06.613700 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef74027-2c99-4339-be86-12f2be91d962 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:06.614211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef74027-2c99-4339-be86-12f2be91d962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:06.616718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-aef74027-2c99-4339-be86-12f2be91d962 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:06.712369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef74027-2c99-4339-be86-12f2be91d962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:06.714262 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef74027-2c99-4339-be86-12f2be91d962 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:06.732645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 565/1117] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:08.795535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9a52d-dde1-42ce-95c9-922abe626892 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:08.796156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9a52d-dde1-42ce-95c9-922abe626892 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:08.796156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9a52d-dde1-42ce-95c9-922abe626892 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:08.797401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 553/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:08.804022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39253d72-b791-484a-a9a2-31182b23fa39 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:08.804756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39253d72-b791-484a-a9a2-31182b23fa39 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:08.804894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39253d72-b791-484a-a9a2-31182b23fa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:08.852594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:08.879222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-39253d72-b791-484a-a9a2-31182b23fa39 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:08.880458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-39253d72-b791-484a-a9a2-31182b23fa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:08.980033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 566/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:09.274017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9a52d-dde1-42ce-95c9-922abe626892 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:09.276405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-29c9a52d-dde1-42ce-95c9-922abe626892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:09.392295 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9a52d-dde1-42ce-95c9-922abe626892 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:09.427877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:09.476293 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11d78a-24ee-46a8-a59e-5b7461e2945c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:09.476894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d78a-24ee-46a8-a59e-5b7461e2945c service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:09.477166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d78a-24ee-46a8-a59e-5b7461e2945c service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:09.477433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d78a-24ee-46a8-a59e-5b7461e2945c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:09.479109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3c11d78a-24ee-46a8-a59e-5b7461e2945c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:09.594093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11d78a-24ee-46a8-a59e-5b7461e2945c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:09.595570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11d78a-24ee-46a8-a59e-5b7461e2945c service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:09.614436 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 554/1120] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:11.923237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ad90d-560e-4687-984d-47c1c80bacca None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:11.924161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ad90d-560e-4687-984d-47c1c80bacca None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:11.924161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ad90d-560e-4687-984d-47c1c80bacca None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:11.926180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 567/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:11.934510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069367-6ea9-4112-81f1-446c4e0ebd72 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:11.934986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069367-6ea9-4112-81f1-446c4e0ebd72 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:11.935101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069367-6ea9-4112-81f1-446c4e0ebd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:12.002850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-43069367-6ea9-4112-81f1-446c4e0ebd72 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:12.004098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-43069367-6ea9-4112-81f1-446c4e0ebd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:12.017148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:12.102859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 555/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:12.389755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ad90d-560e-4687-984d-47c1c80bacca None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:12.392308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9e8ad90d-560e-4687-984d-47c1c80bacca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:12.510385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ad90d-560e-4687-984d-47c1c80bacca None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:12.524468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:12.596333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53d2bd-675f-4a74-b0d6-48d671627dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:12.596937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d2bd-675f-4a74-b0d6-48d671627dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:12.597216 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d2bd-675f-4a74-b0d6-48d671627dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:12.597481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d2bd-675f-4a74-b0d6-48d671627dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:12.599105 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fd53d2bd-675f-4a74-b0d6-48d671627dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:12.712905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53d2bd-675f-4a74-b0d6-48d671627dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:12.714255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53d2bd-675f-4a74-b0d6-48d671627dc5 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:12.732542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 568/1123] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:15.202206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3115-bc8b-4796-982b-1aca2564ede8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:15.202793 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3115-bc8b-4796-982b-1aca2564ede8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:15.202793 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3115-bc8b-4796-982b-1aca2564ede8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:15.204135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 556/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:15.210622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac464c1b-caac-4b0e-80a7-aacf9f887a58 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:15.211394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac464c1b-caac-4b0e-80a7-aacf9f887a58 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:15.211564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac464c1b-caac-4b0e-80a7-aacf9f887a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:15.270512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:15.289615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ac464c1b-caac-4b0e-80a7-aacf9f887a58 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:15.290829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ac464c1b-caac-4b0e-80a7-aacf9f887a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:15.395725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 569/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:15.679936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd3115-bc8b-4796-982b-1aca2564ede8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:15.681522 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fafd3115-bc8b-4796-982b-1aca2564ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:15.791778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd3115-bc8b-4796-982b-1aca2564ede8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:15.843197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:15.879640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d876589-ce1b-4726-bdee-d76bd155f25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:15.880341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d876589-ce1b-4726-bdee-d76bd155f25e service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:15.880614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d876589-ce1b-4726-bdee-d76bd155f25e service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:15.880914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d876589-ce1b-4726-bdee-d76bd155f25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:15.882882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6d876589-ce1b-4726-bdee-d76bd155f25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:16.001377 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d876589-ce1b-4726-bdee-d76bd155f25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:16.002795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d876589-ce1b-4726-bdee-d76bd155f25e service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:16.028666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 557/1126] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:18.297500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147b1d3-0b35-4c78-878c-a433b99d34c4 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:18.298063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147b1d3-0b35-4c78-878c-a433b99d34c4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:18.298063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147b1d3-0b35-4c78-878c-a433b99d34c4 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:18.299414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 570/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:18.306056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a9df-b3b2-4c1c-abf8-0136ba77d5ca None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:18.306503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a9df-b3b2-4c1c-abf8-0136ba77d5ca None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:18.306611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a9df-b3b2-4c1c-abf8-0136ba77d5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:18.383194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6b33a9df-b3b2-4c1c-abf8-0136ba77d5ca None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:18.384409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6b33a9df-b3b2-4c1c-abf8-0136ba77d5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:18.411675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:18.496774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 558/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:18.781124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147b1d3-0b35-4c78-878c-a433b99d34c4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:18.783590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8147b1d3-0b35-4c78-878c-a433b99d34c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:18.904815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147b1d3-0b35-4c78-878c-a433b99d34c4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:18.928179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:18.984919 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132a403-0bdc-4d2a-9a43-a992f1d670ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:18.985519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132a403-0bdc-4d2a-9a43-a992f1d670ab service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:18.985787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132a403-0bdc-4d2a-9a43-a992f1d670ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:18.986054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132a403-0bdc-4d2a-9a43-a992f1d670ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:18.987674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d132a403-0bdc-4d2a-9a43-a992f1d670ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:19.103514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132a403-0bdc-4d2a-9a43-a992f1d670ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:19.104967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132a403-0bdc-4d2a-9a43-a992f1d670ab service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:19.123118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 571/1129] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:21.329248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e70e68-8b45-43e9-8f9f-39633a35bba0 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:21.330188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e70e68-8b45-43e9-8f9f-39633a35bba0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:21.330188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e70e68-8b45-43e9-8f9f-39633a35bba0 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:21.332325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 559/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:21.338152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50df66-2519-4ca3-b6ec-8af7890ce80d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:21.338608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50df66-2519-4ca3-b6ec-8af7890ce80d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:21.338710 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50df66-2519-4ca3-b6ec-8af7890ce80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:21.407744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:21.410870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0b50df66-2519-4ca3-b6ec-8af7890ce80d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:21.412870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0b50df66-2519-4ca3-b6ec-8af7890ce80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:21.514599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 572/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:21.807855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e70e68-8b45-43e9-8f9f-39633a35bba0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:21.809985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d7e70e68-8b45-43e9-8f9f-39633a35bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:21.926261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e70e68-8b45-43e9-8f9f-39633a35bba0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:21.979618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:22.005150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7a5c8-c566-4159-89d5-46154a7876b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:22.005749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7a5c8-c566-4159-89d5-46154a7876b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:22.006020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7a5c8-c566-4159-89d5-46154a7876b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:22.006280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7a5c8-c566-4159-89d5-46154a7876b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:22.007901 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3eb7a5c8-c566-4159-89d5-46154a7876b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:22.126484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7a5c8-c566-4159-89d5-46154a7876b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:22.127891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7a5c8-c566-4159-89d5-46154a7876b7 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:22.147018 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 560/1132] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:24.343381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957044aa-2003-4a55-a914-7af82bbb1b85 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:24.343952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957044aa-2003-4a55-a914-7af82bbb1b85 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:24.343952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957044aa-2003-4a55-a914-7af82bbb1b85 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:24.345255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 573/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:24.351989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc3ed-029f-4661-abc8-ed20dd2f7f0a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:24.352780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc3ed-029f-4661-abc8-ed20dd2f7f0a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:24.352964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc3ed-029f-4661-abc8-ed20dd2f7f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:24.427718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a4dbc3ed-029f-4661-abc8-ed20dd2f7f0a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:24.428937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a4dbc3ed-029f-4661-abc8-ed20dd2f7f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:24.458282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:24.528080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 561/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:24.813439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957044aa-2003-4a55-a914-7af82bbb1b85 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:24.815014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-957044aa-2003-4a55-a914-7af82bbb1b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:24.926882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957044aa-2003-4a55-a914-7af82bbb1b85 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:24.962954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:25.012933 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626f176-086b-43b7-8002-48558483c73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:25.013547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626f176-086b-43b7-8002-48558483c73d service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:25.013825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626f176-086b-43b7-8002-48558483c73d service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:25.014100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626f176-086b-43b7-8002-48558483c73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:25.015740 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5626f176-086b-43b7-8002-48558483c73d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:25.132421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626f176-086b-43b7-8002-48558483c73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:25.133886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626f176-086b-43b7-8002-48558483c73d service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:25.153459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 574/1135] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:27.358345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e70a15-2ef5-435b-a99c-e3be63836f2a None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:27.359357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e70a15-2ef5-435b-a99c-e3be63836f2a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:27.359357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e70a15-2ef5-435b-a99c-e3be63836f2a None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:27.361452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 562/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:27.367673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90668336-a169-4961-ae9f-793e5746cf80 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:27.368147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90668336-a169-4961-ae9f-793e5746cf80 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:27.368241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90668336-a169-4961-ae9f-793e5746cf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:27.458342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-90668336-a169-4961-ae9f-793e5746cf80 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:27.460293 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-90668336-a169-4961-ae9f-793e5746cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:27.471232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:27.573728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 575/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:27.883369 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e70a15-2ef5-435b-a99c-e3be63836f2a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:27.886200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-71e70a15-2ef5-435b-a99c-e3be63836f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:28.008203 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e70a15-2ef5-435b-a99c-e3be63836f2a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:28.079654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:28.098907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc340bc-4d32-4e8d-899f-5fd22652dfef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:28.099549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc340bc-4d32-4e8d-899f-5fd22652dfef service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:28.099812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc340bc-4d32-4e8d-899f-5fd22652dfef service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:28.100084 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc340bc-4d32-4e8d-899f-5fd22652dfef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:28.102039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dcc340bc-4d32-4e8d-899f-5fd22652dfef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:28.236369 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc340bc-4d32-4e8d-899f-5fd22652dfef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:28.237799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc340bc-4d32-4e8d-899f-5fd22652dfef service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:28.256745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 563/1138] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:30.502038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5763c01-9a29-445e-a94e-b1a5b79b03aa None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:30.502586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5763c01-9a29-445e-a94e-b1a5b79b03aa None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:30.502586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5763c01-9a29-445e-a94e-b1a5b79b03aa None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:30.504686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 576/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:30.512547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1d4ef-7c2e-4d5c-982c-1b6b026341a5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:30.513081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1d4ef-7c2e-4d5c-982c-1b6b026341a5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:30.513192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1d4ef-7c2e-4d5c-982c-1b6b026341a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:30.583146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-54f1d4ef-7c2e-4d5c-982c-1b6b026341a5 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:30.584335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-54f1d4ef-7c2e-4d5c-982c-1b6b026341a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:30.624239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:30.687296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 564/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:30.982686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5763c01-9a29-445e-a94e-b1a5b79b03aa None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:30.984265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b5763c01-9a29-445e-a94e-b1a5b79b03aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:31.097916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5763c01-9a29-445e-a94e-b1a5b79b03aa None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:31.137280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:31.175722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504b613-6dbd-4623-941f-dca969a3cf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:31.176324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504b613-6dbd-4623-941f-dca969a3cf18 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:31.176593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504b613-6dbd-4623-941f-dca969a3cf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:31.176912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504b613-6dbd-4623-941f-dca969a3cf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:31.178527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2504b613-6dbd-4623-941f-dca969a3cf18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:31.293278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504b613-6dbd-4623-941f-dca969a3cf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:31.294970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504b613-6dbd-4623-941f-dca969a3cf18 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:31.313533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 577/1141] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:33.445443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f3e00-93a9-452b-9967-93e83afa2d81 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:33.446335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f3e00-93a9-452b-9967-93e83afa2d81 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:33.446335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f3e00-93a9-452b-9967-93e83afa2d81 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:33.448513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 565/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:33.455139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec347f9-d9ba-4399-9c85-cc2d2b50cfee None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:33.455928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec347f9-d9ba-4399-9c85-cc2d2b50cfee None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:33.456078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec347f9-d9ba-4399-9c85-cc2d2b50cfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:33.532711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0ec347f9-d9ba-4399-9c85-cc2d2b50cfee None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:33.534580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0ec347f9-d9ba-4399-9c85-cc2d2b50cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:33.562945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:33.642632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 578/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:33.933443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f3e00-93a9-452b-9967-93e83afa2d81 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:33.936055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-894f3e00-93a9-452b-9967-93e83afa2d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:34.050524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f3e00-93a9-452b-9967-93e83afa2d81 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:34.119503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:34.128861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceb5e4-38dd-44dc-8a9a-8d87c4e8174b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:34.129690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb5e4-38dd-44dc-8a9a-8d87c4e8174b service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:34.130013 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb5e4-38dd-44dc-8a9a-8d87c4e8174b service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:34.130313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb5e4-38dd-44dc-8a9a-8d87c4e8174b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:34.132948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-26ceb5e4-38dd-44dc-8a9a-8d87c4e8174b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:34.256172 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceb5e4-38dd-44dc-8a9a-8d87c4e8174b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:34.257596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceb5e4-38dd-44dc-8a9a-8d87c4e8174b service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:34.276463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 566/1144] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:36.457991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e195de-d912-484d-9f2f-0df8f7f9cf63 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:36.458816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e195de-d912-484d-9f2f-0df8f7f9cf63 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:36.458816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e195de-d912-484d-9f2f-0df8f7f9cf63 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:36.460965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 579/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:36:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:36.466641 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9381c33-4dad-4dc5-a6e4-c6706104b3b6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:36.467117 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9381c33-4dad-4dc5-a6e4-c6706104b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:36.467209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9381c33-4dad-4dc5-a6e4-c6706104b3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:36.542574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b9381c33-4dad-4dc5-a6e4-c6706104b3b6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:36.543918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b9381c33-4dad-4dc5-a6e4-c6706104b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:36.608218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:36.659652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 567/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:36.944235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e195de-d912-484d-9f2f-0df8f7f9cf63 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:36.946658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d5e195de-d912-484d-9f2f-0df8f7f9cf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:37.069047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e195de-d912-484d-9f2f-0df8f7f9cf63 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:37.128254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:37.158857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a145643-633b-48c5-b766-27dcedbea20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:37.159494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145643-633b-48c5-b766-27dcedbea20e service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:37.159764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145643-633b-48c5-b766-27dcedbea20e service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:37.160027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145643-633b-48c5-b766-27dcedbea20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:37.161611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9a145643-633b-48c5-b766-27dcedbea20e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:37.293557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a145643-633b-48c5-b766-27dcedbea20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:37.295034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a145643-633b-48c5-b766-27dcedbea20e service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:37.313438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 580/1147] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:36:46.657999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=22 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:47.311126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=66 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:57.213394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790b4f-3170-4dfd-8cbd-f09e32998461 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:57.214254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790b4f-3170-4dfd-8cbd-f09e32998461 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:57.214254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790b4f-3170-4dfd-8cbd-f09e32998461 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:57.216292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 568/1148] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:36:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:57.225033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5e1a5-1548-4599-9688-b21918136593 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:57.225471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5e1a5-1548-4599-9688-b21918136593 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:57.225563 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5e1a5-1548-4599-9688-b21918136593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:57.297347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0ca5e1a5-1548-4599-9688-b21918136593 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:57.298541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0ca5e1a5-1548-4599-9688-b21918136593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:57.403333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 581/1149] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:36:57.706724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e6d1-cda1-4933-8d30-f27ec0d7c242 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:57.707093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e6d1-cda1-4933-8d30-f27ec0d7c242 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:57.707366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e6d1-cda1-4933-8d30-f27ec0d7c242 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:57.708691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 569/1150] 10.222.0.46 () {54 vars in 962 bytes} [Mon Oct 24 13:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:36:57.715596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801fadf-6a18-4f66-9322-4b77f01b32f5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:57.715878 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801fadf-6a18-4f66-9322-4b77f01b32f5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:57.716147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801fadf-6a18-4f66-9322-4b77f01b32f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:57.794029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1801fadf-6a18-4f66-9322-4b77f01b32f5 None None] MFA Rules not processed for user `68d8ec9210f54c6698477d7dbbe46a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:36:57.795262 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1801fadf-6a18-4f66-9322-4b77f01b32f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:57.817637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:57.876526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 582/1151] 10.222.0.46 () {58 vars in 1059 bytes} [Mon Oct 24 13:36:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:36:57.884748 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e6d1-cda1-4933-8d30-f27ec0d7c242 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:36:57.886302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3494e6d1-cda1-4933-8d30-f27ec0d7c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:57.991952 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e6d1-cda1-4933-8d30-f27ec0d7c242 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:36:58.067144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b8bd7-4b15-45db-bc88-2ff6324e094e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8ec9210f54c6698477d7dbbe46a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:36:58.067652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8bd7-4b15-45db-bc88-2ff6324e094e service glance] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:36:58.067924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8bd7-4b15-45db-bc88-2ff6324e094e service glance] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:36:58.068186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8bd7-4b15-45db-bc88-2ff6324e094e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:36:58.069744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-953b8bd7-4b15-45db-bc88-2ff6324e094e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:36:58.131586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:58.190136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b8bd7-4b15-45db-bc88-2ff6324e094e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:36:58.191615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b8bd7-4b15-45db-bc88-2ff6324e094e service glance] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:36:58.210557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 570/1152] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:37:00.428666 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816e11-e3b2-439b-b4b2-8f572ad7c177 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:00.429236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816e11-e3b2-439b-b4b2-8f572ad7c177 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:00.429236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816e11-e3b2-439b-b4b2-8f572ad7c177 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:00.430557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 583/1153] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:37:00.435984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620795b-78d5-49f4-9445-1d1e8b3ae697 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:00.436426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620795b-78d5-49f4-9445-1d1e8b3ae697 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:00.436522 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620795b-78d5-49f4-9445-1d1e8b3ae697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:00.502672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1620795b-78d5-49f4-9445-1d1e8b3ae697 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:37:00.503891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1620795b-78d5-49f4-9445-1d1e8b3ae697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:00.606470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 571/1154] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:37:00.886415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816e11-e3b2-439b-b4b2-8f572ad7c177 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:37:00.887906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-79816e11-e3b2-439b-b4b2-8f572ad7c177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:01.018826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816e11-e3b2-439b-b4b2-8f572ad7c177 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:37:01.071834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:01.117616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424ea05-2f57-40a0-9571-bce1ebcd46f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:37:01.118218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ea05-2f57-40a0-9571-bce1ebcd46f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:01.118489 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ea05-2f57-40a0-9571-bce1ebcd46f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:01.118754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ea05-2f57-40a0-9571-bce1ebcd46f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:01.119421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424ea05-2f57-40a0-9571-bce1ebcd46f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:37:01.120528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-9424ea05-2f57-40a0-9571-bce1ebcd46f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:37:01.120528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: warnings.warn(msg) Oct 24 13:37:01.120528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: Oct 24 13:37:01.121747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424ea05-2f57-40a0-9571-bce1ebcd46f0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:37:01.141705 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 584/1155] 10.222.0.46 () {56 vars in 1108 bytes} [Mon Oct 24 13:37:00 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:37:03.295811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d198363-9039-431f-90b2-1f992a53a854 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:03.296700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d198363-9039-431f-90b2-1f992a53a854 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:03.296700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d198363-9039-431f-90b2-1f992a53a854 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:03.298312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 572/1156] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:37:03.303999 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04793d49-de3a-4fa3-9c40-f41e2442ae05 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:03.304441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04793d49-de3a-4fa3-9c40-f41e2442ae05 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:03.304547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04793d49-de3a-4fa3-9c40-f41e2442ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:03.379127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-04793d49-de3a-4fa3-9c40-f41e2442ae05 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:37:03.380354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-04793d49-de3a-4fa3-9c40-f41e2442ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:03.498544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 585/1157] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:37:03.794395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d198363-9039-431f-90b2-1f992a53a854 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:37:03.795986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6d198363-9039-431f-90b2-1f992a53a854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:03.806093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:03.954267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d198363-9039-431f-90b2-1f992a53a854 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:37:04.037784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:04.070158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d19cc-60a6-4d30-850a-8711a1459953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:37:04.070761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d19cc-60a6-4d30-850a-8711a1459953 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:04.071059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d19cc-60a6-4d30-850a-8711a1459953 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:04.071325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d19cc-60a6-4d30-850a-8711a1459953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:04.072902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bb3d19cc-60a6-4d30-850a-8711a1459953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:04.180308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d19cc-60a6-4d30-850a-8711a1459953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:37:04.181913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d19cc-60a6-4d30-850a-8711a1459953 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:37:04.202098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 573/1158] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:37:06.562240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c8129-b1ad-4754-baae-246fd83c4fc0 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:06.570881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c8129-b1ad-4754-baae-246fd83c4fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:06.570881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c8129-b1ad-4754-baae-246fd83c4fc0 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:06.570881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 586/1159] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:37:06.571260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880f414-f00a-4ac8-8d54-9e4d91ed651e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:06.571260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880f414-f00a-4ac8-8d54-9e4d91ed651e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:06.571260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880f414-f00a-4ac8-8d54-9e4d91ed651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:06.662367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b880f414-f00a-4ac8-8d54-9e4d91ed651e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:37:06.663614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b880f414-f00a-4ac8-8d54-9e4d91ed651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:06.712358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:06.765273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 574/1160] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:37:07.052027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c8129-b1ad-4754-baae-246fd83c4fc0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:37:07.054513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-046c8129-b1ad-4754-baae-246fd83c4fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:07.088695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:07.178190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c8129-b1ad-4754-baae-246fd83c4fc0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:37:07.262100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e15b-bd32-41d7-b8e7-2c9c15c9426c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:37:07.262711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e15b-bd32-41d7-b8e7-2c9c15c9426c service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:07.263011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e15b-bd32-41d7-b8e7-2c9c15c9426c service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:07.263279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e15b-bd32-41d7-b8e7-2c9c15c9426c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:07.264865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1711e15b-bd32-41d7-b8e7-2c9c15c9426c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:07.355745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:07.405807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711e15b-bd32-41d7-b8e7-2c9c15c9426c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:37:07.407490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711e15b-bd32-41d7-b8e7-2c9c15c9426c service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:37:07.427015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 587/1161] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:37:09.595634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021256d-14c5-463f-9419-245404c0a807 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:09.596082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021256d-14c5-463f-9419-245404c0a807 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:09.596228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021256d-14c5-463f-9419-245404c0a807 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:09.598081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 575/1162] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:37:09.605800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0e4c-f653-4e6c-9e4a-497748ac744b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:09.606278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0e4c-f653-4e6c-9e4a-497748ac744b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:09.606382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0e4c-f653-4e6c-9e4a-497748ac744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:09.688699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3a3d0e4c-f653-4e6c-9e4a-497748ac744b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:37:09.689908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3a3d0e4c-f653-4e6c-9e4a-497748ac744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:09.788027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 588/1163] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:37:10.079535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021256d-14c5-463f-9419-245404c0a807 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:37:10.081098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8021256d-14c5-463f-9419-245404c0a807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:10.201619 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021256d-14c5-463f-9419-245404c0a807 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:37:10.282857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:10.284368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a857a1-b9be-4955-80b3-8ca94d6bfc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:37:10.284977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a857a1-b9be-4955-80b3-8ca94d6bfc35 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:10.285186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a857a1-b9be-4955-80b3-8ca94d6bfc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:10.285482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a857a1-b9be-4955-80b3-8ca94d6bfc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:10.287415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-76a857a1-b9be-4955-80b3-8ca94d6bfc35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:10.405059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a857a1-b9be-4955-80b3-8ca94d6bfc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:37:10.406577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a857a1-b9be-4955-80b3-8ca94d6bfc35 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:37:10.425898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 576/1164] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:37:12.664651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06804-b220-4aa7-9514-fcd0e72f6ea7 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:12.665600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06804-b220-4aa7-9514-fcd0e72f6ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:12.665600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06804-b220-4aa7-9514-fcd0e72f6ea7 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:12.667658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 589/1165] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:37:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:37:12.673271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c315-c355-4537-8543-ea65999de117 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:12.673751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c315-c355-4537-8543-ea65999de117 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:12.673841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c315-c355-4537-8543-ea65999de117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:12.756507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9c94c315-c355-4537-8543-ea65999de117 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:37:12.757715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9c94c315-c355-4537-8543-ea65999de117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:12.815108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:12.865013 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 577/1166] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:37:13.169282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae06804-b220-4aa7-9514-fcd0e72f6ea7 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:37:13.171856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cae06804-b220-4aa7-9514-fcd0e72f6ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:13.216203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:13.289918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae06804-b220-4aa7-9514-fcd0e72f6ea7 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:37:13.366680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac520-561f-4621-b822-ba731ffd7364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:37:13.367305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac520-561f-4621-b822-ba731ffd7364 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:13.367580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac520-561f-4621-b822-ba731ffd7364 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:13.367846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac520-561f-4621-b822-ba731ffd7364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:13.369430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1fdac520-561f-4621-b822-ba731ffd7364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:13.456349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:13.487890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac520-561f-4621-b822-ba731ffd7364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:37:13.489344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac520-561f-4621-b822-ba731ffd7364 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:37:13.508568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 590/1167] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:37:15.852629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5985c-369f-4d00-8212-455d7eeda559 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:15.853502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5985c-369f-4d00-8212-455d7eeda559 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:15.853502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5985c-369f-4d00-8212-455d7eeda559 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:15.855727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 578/1168] 10.222.0.46 () {54 vars in 927 bytes} [Mon Oct 24 13:37:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:37:15.861355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb62ec-1f9b-4cbf-9b05-9730b2208cc7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:15.861818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb62ec-1f9b-4cbf-9b05-9730b2208cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:15.861920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb62ec-1f9b-4cbf-9b05-9730b2208cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:15.928726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d4bb62ec-1f9b-4cbf-9b05-9730b2208cc7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:37:15.929947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d4bb62ec-1f9b-4cbf-9b05-9730b2208cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:16.048140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 591/1169] 10.222.0.46 () {58 vars in 1024 bytes} [Mon Oct 24 13:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:37:16.336633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5985c-369f-4d00-8212-455d7eeda559 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:37:16.339161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-83f5985c-369f-4d00-8212-455d7eeda559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:16.457724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5985c-369f-4d00-8212-455d7eeda559 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:37:16.531186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495e68-c282-4af8-a792-3cc0079bc0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:37:16.531786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495e68-c282-4af8-a792-3cc0079bc0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:37:16.532148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495e68-c282-4af8-a792-3cc0079bc0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:37:16.532395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495e68-c282-4af8-a792-3cc0079bc0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:37:16.533975 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4b495e68-c282-4af8-a792-3cc0079bc0d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:37:16.543753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:16.648514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495e68-c282-4af8-a792-3cc0079bc0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:37:16.649943 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495e68-c282-4af8-a792-3cc0079bc0d2 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:37:16.668795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 579/1170] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:37:26.046390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=82 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:26.666587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=50 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:30.277549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aedfaa-31e0-43c9-b0d6-674ffbf44ff3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:30.278097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aedfaa-31e0-43c9-b0d6-674ffbf44ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:30.278097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aedfaa-31e0-43c9-b0d6-674ffbf44ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:30.365957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-78aedfaa-31e0-43c9-b0d6-674ffbf44ff3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:38:30.367117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-78aedfaa-31e0-43c9-b0d6-674ffbf44ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:30.465738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 592/1171] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:38:30.476676 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821aec6-339a-485a-af21-3eac10d04596 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:30.477185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821aec6-339a-485a-af21-3eac10d04596 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:30.477185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821aec6-339a-485a-af21-3eac10d04596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:30.554479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0821aec6-339a-485a-af21-3eac10d04596 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:38:30.555710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0821aec6-339a-485a-af21-3eac10d04596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:30.657919 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 580/1172] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:38:30.662690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aedfaa-31e0-43c9-b0d6-674ffbf44ff3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:30.663950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-78aedfaa-31e0-43c9-b0d6-674ffbf44ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:30.675469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aedfaa-31e0-43c9-b0d6-674ffbf44ff3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:30.743858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:30.780776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:30.781390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:30.781658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:30.781926 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:30.782566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:38:30.782872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:30.783931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:38:30.783931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: warnings.warn(msg) Oct 24 13:38:30.783931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: Oct 24 13:38:30.784810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:30.796900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 593/1173] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:38:30.807150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821aec6-339a-485a-af21-3eac10d04596 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:30.816941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821aec6-339a-485a-af21-3eac10d04596 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:30.884581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:30.924374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:30.924879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:30.925145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:30.925408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:30.926027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:30.927211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:38:30.927211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: warnings.warn(msg) Oct 24 13:38:30.927211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: Oct 24 13:38:30.928392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:30.987509 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 581/1174] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:38:30 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:38:30.992156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:30.993685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:31.027357 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fa81-dc21-4e27-bde9-5755bdeb5969 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:31.123915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:31.124517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:31.124790 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:31.125059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:31.125679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:31.126702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:38:31.126702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: warnings.warn(msg) Oct 24 13:38:31.126702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: Oct 24 13:38:31.127935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:31.173766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 594/1175] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:38:30 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:38:31.178954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:31.181141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:31.245887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cacae-2882-4b14-8cc9-047e7ec9ae7c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:31.337918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:31.349403 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260172d-44e4-4f44-87c4-91df28852a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:31.350024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260172d-44e4-4f44-87c4-91df28852a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:31.350292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260172d-44e4-4f44-87c4-91df28852a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:31.350555 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260172d-44e4-4f44-87c4-91df28852a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:31.351237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260172d-44e4-4f44-87c4-91df28852a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:31.352856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260172d-44e4-4f44-87c4-91df28852a37 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:31.365790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 582/1176] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:38:31.370043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:31.371615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:31.383824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb151b-21fa-4624-a98f-bb5bb10f8fd4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:31.410175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:31.485543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9c09e-edf2-4f0f-94a8-c88264dd0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:31.486078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9c09e-edf2-4f0f-94a8-c88264dd0a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:31.486382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9c09e-edf2-4f0f-94a8-c88264dd0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:31.486649 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9c09e-edf2-4f0f-94a8-c88264dd0a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:31.487328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9c09e-edf2-4f0f-94a8-c88264dd0a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:31.488994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9c09e-edf2-4f0f-94a8-c88264dd0a76 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:31.502450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 595/1177] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:38:31.507198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260172d-44e4-4f44-87c4-91df28852a37 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:31.508744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5260172d-44e4-4f44-87c4-91df28852a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:31.545778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260172d-44e4-4f44-87c4-91df28852a37 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:31.645704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b45c-3913-4adb-88aa-b7a657710c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:31.646528 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b45c-3913-4adb-88aa-b7a657710c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:31.646848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b45c-3913-4adb-88aa-b7a657710c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:31.647091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b45c-3913-4adb-88aa-b7a657710c2b admin admin] PATH_INFO: `/v3/projects/6d7f29789e884dc384a6afad7c3a302c/users/6fdd501cc86f4a799b56572476884abc/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:31.672062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053b45c-3913-4adb-88aa-b7a657710c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d7f29789e884dc384a6afad7c3a302c, user_id=6fdd501cc86f4a799b56572476884abc, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:31.674713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053b45c-3913-4adb-88aa-b7a657710c2b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:31.703549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 583/1178] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:38:31 2022] PUT /identity/v3/projects/6d7f29789e884dc384a6afad7c3a302c/users/6fdd501cc86f4a799b56572476884abc/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:38:31.715080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b31e-2cd7-4272-9e67-0a78b18dbc08 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:31.715363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b31e-2cd7-4272-9e67-0a78b18dbc08 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:31.715635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b31e-2cd7-4272-9e67-0a78b18dbc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:31.772788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1f67b31e-2cd7-4272-9e67-0a78b18dbc08 None None] MFA Rules not processed for user `6fdd501cc86f4a799b56572476884abc`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:38:31.773910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1f67b31e-2cd7-4272-9e67-0a78b18dbc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:31.858908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 596/1179] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:38:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:38:31.873002 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d7ad2-afd6-4c4b-8df0-efa2e6fa23be None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:31.873282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d7ad2-afd6-4c4b-8df0-efa2e6fa23be None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:31.873521 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d7ad2-afd6-4c4b-8df0-efa2e6fa23be None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:31.874874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 584/1180] 10.222.0.46 () {54 vars in 963 bytes} [Mon Oct 24 13:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:38:31.879805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b088a-5317-44e6-81c5-46dfb18cdcc5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:31.880089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b088a-5317-44e6-81c5-46dfb18cdcc5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:31.880361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b088a-5317-44e6-81c5-46dfb18cdcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:31.914824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:31.961494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d17b088a-5317-44e6-81c5-46dfb18cdcc5 None None] MFA Rules not processed for user `37c812964d514d3f8082f90d0f512246`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:38:31.962688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d17b088a-5317-44e6-81c5-46dfb18cdcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:32.041171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 597/1181] 10.222.0.46 () {58 vars in 1060 bytes} [Mon Oct 24 13:38:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:38:32.053664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d7ad2-afd6-4c4b-8df0-efa2e6fa23be None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:32.056062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ce5d7ad2-afd6-4c4b-8df0-efa2e6fa23be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:32.113020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:32.170902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d7ad2-afd6-4c4b-8df0-efa2e6fa23be None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:32.246385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:32.247017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:32.247277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:32.247554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:32.249145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:32.357198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:32.359209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:32.364589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:32.380584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 585/1182] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:38:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:38:32.428306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336356-6448-45bb-bad1-0dcfe99cc449 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:32.428745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336356-6448-45bb-bad1-0dcfe99cc449 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:32.428843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336356-6448-45bb-bad1-0dcfe99cc449 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:32.430110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 598/1183] 10.222.0.46 () {52 vars in 830 bytes} [Mon Oct 24 13:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:38:32.433975 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:32.435236 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:32.541051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69155c61-5a75-43ca-8050-82b5ed36e25d service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:32.637095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:32.637639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:32.637906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:32.638167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] PATH_INFO: `/v3/users/6fdd501cc86f4a799b56572476884abc` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:32.651991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdd501cc86f4a799b56572476884abc)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:32.653012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:38:32.653012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: warnings.warn(msg) Oct 24 13:38:32.653012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: Oct 24 13:38:32.654224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:32.664375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:32.727940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdd501cc86f4a799b56572476884abc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:32.728352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdd501cc86f4a799b56572476884abc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:32.744100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdd501cc86f4a799b56572476884abc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:32.769092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdd501cc86f4a799b56572476884abc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:32.770000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdd501cc86f4a799b56572476884abc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:32.788296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 586/1184] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:38:32 2022] DELETE /identity/v3/users/6fdd501cc86f4a799b56572476884abc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:38:32.793001 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e506-dee8-43b1-a77b-1517597692ee None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:32.793284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e506-dee8-43b1-a77b-1517597692ee None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:32.793553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e506-dee8-43b1-a77b-1517597692ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:32.854173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8f83e506-dee8-43b1-a77b-1517597692ee None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:38:32.855436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8f83e506-dee8-43b1-a77b-1517597692ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:32.935218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:32.948139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 599/1185] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:38:32.961427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:32.962722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:33.074310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350933-d2be-42d8-9008-1430b130bdd1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:33.130356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:33.154808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8b4e0-521d-4ff2-86fe-30b7bdbb3a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:33.155461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8b4e0-521d-4ff2-86fe-30b7bdbb3a8c service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:33.155735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8b4e0-521d-4ff2-86fe-30b7bdbb3a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:33.156002 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8b4e0-521d-4ff2-86fe-30b7bdbb3a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:33.157627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ccf8b4e0-521d-4ff2-86fe-30b7bdbb3a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:33.268004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8b4e0-521d-4ff2-86fe-30b7bdbb3a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:33.269345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8b4e0-521d-4ff2-86fe-30b7bdbb3a8c service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:33.288634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 587/1186] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:38:33.743060 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e506-dee8-43b1-a77b-1517597692ee None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:38:33.744333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8f83e506-dee8-43b1-a77b-1517597692ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:38:33.756119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e506-dee8-43b1-a77b-1517597692ee None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:38:33.856602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:38:33.857156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:38:33.857431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:38:33.857702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] PATH_INFO: `/v3/projects/6d7f29789e884dc384a6afad7c3a302c` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:38:33.869117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d7f29789e884dc384a6afad7c3a302c)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:38:33.870194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:38:33.870194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: warnings.warn(msg) Oct 24 13:38:33.870194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: Oct 24 13:38:33.871472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:38:33.937984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d7f29789e884dc384a6afad7c3a302c', 'request_id': 'req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:33.944956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d7f29789e884dc384a6afad7c3a302c', 'request_id': 'req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:33.959765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d7f29789e884dc384a6afad7c3a302c', 'request_id': 'req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:33.993626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] The token cache is being invalidate because project 6d7f29789e884dc384a6afad7c3a302c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:38:33.993986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:33.994314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f36e6e1-e8b6-49b2-a118-1f1b7e6e1d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:38:33.995753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 600/1187] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:38:33 2022] DELETE /identity/v3/projects/6d7f29789e884dc384a6afad7c3a302c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:38:43.286075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=62 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:43.991258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:08.393292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24474b99-aae5-4aea-a316-27ff531ed12b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:08.394458 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24474b99-aae5-4aea-a316-27ff531ed12b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:08.394742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24474b99-aae5-4aea-a316-27ff531ed12b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:08.396861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 588/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:40:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:40:08.405168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341ca0c-58af-45fe-bc22-163ad4c1b12b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:08.405607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341ca0c-58af-45fe-bc22-163ad4c1b12b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:08.405708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341ca0c-58af-45fe-bc22-163ad4c1b12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:08.492849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f341ca0c-58af-45fe-bc22-163ad4c1b12b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:08.494561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f341ca0c-58af-45fe-bc22-163ad4c1b12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:08.606462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 601/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:40:08.766610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24474b99-aae5-4aea-a316-27ff531ed12b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:40:08.770421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-24474b99-aae5-4aea-a316-27ff531ed12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:08.917666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24474b99-aae5-4aea-a316-27ff531ed12b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:40:08.923907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e69622-580c-4956-9dfc-0520b55910fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:40:08.924522 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e69622-580c-4956-9dfc-0520b55910fc service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:08.924797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e69622-580c-4956-9dfc-0520b55910fc service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:08.925065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e69622-580c-4956-9dfc-0520b55910fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:08.934515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e69622-580c-4956-9dfc-0520b55910fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:40:08.936327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e69622-580c-4956-9dfc-0520b55910fc service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:40:08.946414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 589/1190] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:40:10.025679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d452926-a5da-4949-b645-ed6509f06649 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:10.026239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d452926-a5da-4949-b645-ed6509f06649 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:10.026339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d452926-a5da-4949-b645-ed6509f06649 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:10.027952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 602/1191] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:40:10.033614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0bb8e-a157-4ca9-a2e7-c46b3f2abe63 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:10.034088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0bb8e-a157-4ca9-a2e7-c46b3f2abe63 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:10.034223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0bb8e-a157-4ca9-a2e7-c46b3f2abe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:10.055072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6be0bb8e-a157-4ca9-a2e7-c46b3f2abe63 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:10.056309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6be0bb8e-a157-4ca9-a2e7-c46b3f2abe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:10.064840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 590/1192] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:40:10.219732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d452926-a5da-4949-b645-ed6509f06649 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:40:10.238481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d452926-a5da-4949-b645-ed6509f06649 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:40:10.245272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c855dc3-1220-4cd8-b9a5-da49378afc09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:40:10.245807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c855dc3-1220-4cd8-b9a5-da49378afc09 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:10.246075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c855dc3-1220-4cd8-b9a5-da49378afc09 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:10.246336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c855dc3-1220-4cd8-b9a5-da49378afc09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:10.255260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c855dc3-1220-4cd8-b9a5-da49378afc09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:40:10.256885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c855dc3-1220-4cd8-b9a5-da49378afc09 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:40:10.266949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 603/1193] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:40:10.429714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1737df8-f3e6-478b-8ec7-7afccbdc95f8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:10.429987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1737df8-f3e6-478b-8ec7-7afccbdc95f8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:10.430273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1737df8-f3e6-478b-8ec7-7afccbdc95f8 None None] PATH_INFO: `/v3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:10.431599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 591/1194] 10.222.0.26 () {54 vars in 925 bytes} [Mon Oct 24 13:40:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:40:10.438339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f25b6-71df-45ee-ae8a-3ee3eb9c21fe None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:10.438621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f25b6-71df-45ee-ae8a-3ee3eb9c21fe None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:10.438936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f25b6-71df-45ee-ae8a-3ee3eb9c21fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:10.500437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4e1f25b6-71df-45ee-ae8a-3ee3eb9c21fe None None] MFA Rules not processed for user `0f040c31c0d4439594404739d44a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:10.501548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4e1f25b6-71df-45ee-ae8a-3ee3eb9c21fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:10.519133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:10.577944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 604/1195] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Oct 24 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:40:14.203532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca3d6d-afdf-4206-8f23-9538033d95c4 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:14.204149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca3d6d-afdf-4206-8f23-9538033d95c4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:14.204149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca3d6d-afdf-4206-8f23-9538033d95c4 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:14.205838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 592/1196] 10.222.0.46 () {54 vars in 961 bytes} [Mon Oct 24 13:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:40:14.211204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7e9f-9e93-4716-8955-e5addd721178 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:14.211658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7e9f-9e93-4716-8955-e5addd721178 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:14.211767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7e9f-9e93-4716-8955-e5addd721178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:14.232572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5c7f7e9f-9e93-4716-8955-e5addd721178 None None] MFA Rules not processed for user `0f040c31c0d4439594404739d44a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:14.233793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5c7f7e9f-9e93-4716-8955-e5addd721178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:14.245468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 605/1197] 10.222.0.46 () {58 vars in 1058 bytes} [Mon Oct 24 13:40:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:40:14.254262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca3d6d-afdf-4206-8f23-9538033d95c4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:40:14.271100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca3d6d-afdf-4206-8f23-9538033d95c4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:40:14.279369 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02108e-a79f-4408-bba2-9455d4add8a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:40:14.280332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02108e-a79f-4408-bba2-9455d4add8a0 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:14.280786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02108e-a79f-4408-bba2-9455d4add8a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:14.281228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02108e-a79f-4408-bba2-9455d4add8a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:14.290964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02108e-a79f-4408-bba2-9455d4add8a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:40:14.292529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02108e-a79f-4408-bba2-9455d4add8a0 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:40:14.302410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 593/1198] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:40:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:40:21.726326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa4996-786a-482d-bc19-1b091e70d630 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:21.726918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa4996-786a-482d-bc19-1b091e70d630 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:21.726918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa4996-786a-482d-bc19-1b091e70d630 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:21.728143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 606/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:40:21.734075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc955-9a34-4cb1-9b06-162fc0fe5717 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:21.734798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc955-9a34-4cb1-9b06-162fc0fe5717 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:21.734999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc955-9a34-4cb1-9b06-162fc0fe5717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:21.761639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0c7fc955-9a34-4cb1-9b06-162fc0fe5717 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:21.762830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0c7fc955-9a34-4cb1-9b06-162fc0fe5717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:21.771670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 594/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:40:21.924891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa4996-786a-482d-bc19-1b091e70d630 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:40:21.945611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa4996-786a-482d-bc19-1b091e70d630 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:40:21.952071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a4cb2-4bec-4c16-82a6-a3c8ade3c3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:40:21.952667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a4cb2-4bec-4c16-82a6-a3c8ade3c3a6 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:21.952940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a4cb2-4bec-4c16-82a6-a3c8ade3c3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:21.953207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a4cb2-4bec-4c16-82a6-a3c8ade3c3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:21.961984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a4cb2-4bec-4c16-82a6-a3c8ade3c3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:40:21.963744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a4cb2-4bec-4c16-82a6-a3c8ade3c3a6 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:40:21.973488 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 607/1201] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:40:23.041645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4fb3-6295-4420-8666-eca9f6c4834d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:23.042246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4fb3-6295-4420-8666-eca9f6c4834d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:23.042246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4fb3-6295-4420-8666-eca9f6c4834d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:23.043581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 595/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:40:23.054370 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b798edc-f6c4-4be5-a10e-858a6d75c541 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:23.054895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b798edc-f6c4-4be5-a10e-858a6d75c541 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:23.054895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b798edc-f6c4-4be5-a10e-858a6d75c541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:23.084477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7b798edc-f6c4-4be5-a10e-858a6d75c541 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:23.085659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7b798edc-f6c4-4be5-a10e-858a6d75c541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:23.094780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 608/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:40:23.249255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4fb3-6295-4420-8666-eca9f6c4834d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:40:23.266835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4fb3-6295-4420-8666-eca9f6c4834d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:40:23.273136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dacf0-d919-457e-9c85-b07621669f03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:40:23.273724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dacf0-d919-457e-9c85-b07621669f03 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:23.273993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dacf0-d919-457e-9c85-b07621669f03 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:23.274256 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dacf0-d919-457e-9c85-b07621669f03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:23.282593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dacf0-d919-457e-9c85-b07621669f03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:40:23.284567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dacf0-d919-457e-9c85-b07621669f03 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:40:23.294123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 596/1204] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:40:27.376674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1769d-0f07-412f-8daa-ddb50d9d93df None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:27.377696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1769d-0f07-412f-8daa-ddb50d9d93df None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:27.377696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1769d-0f07-412f-8daa-ddb50d9d93df None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:27.379567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 609/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:40:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:40:27.390843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235586e-5dbf-4f08-b7aa-32f46876b40d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:27.391386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235586e-5dbf-4f08-b7aa-32f46876b40d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:27.391481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235586e-5dbf-4f08-b7aa-32f46876b40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:27.414476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d235586e-5dbf-4f08-b7aa-32f46876b40d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:27.415715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d235586e-5dbf-4f08-b7aa-32f46876b40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:27.423991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 597/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:40:27.710760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1769d-0f07-412f-8daa-ddb50d9d93df None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:40:27.712779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-dab1769d-0f07-412f-8daa-ddb50d9d93df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:27.807260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1769d-0f07-412f-8daa-ddb50d9d93df None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:40:27.811873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83c142-c325-4961-8fc2-3594b843e559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:40:27.812490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83c142-c325-4961-8fc2-3594b843e559 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:27.812749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83c142-c325-4961-8fc2-3594b843e559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:27.813013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83c142-c325-4961-8fc2-3594b843e559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:27.822853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83c142-c325-4961-8fc2-3594b843e559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:40:27.824337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83c142-c325-4961-8fc2-3594b843e559 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:40:27.834110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 610/1207] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:40:29.995565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7908d-d89e-401d-a331-bdcb3c75acf3 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:29.996101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7908d-d89e-401d-a331-bdcb3c75acf3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:29.996101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7908d-d89e-401d-a331-bdcb3c75acf3 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:29.998062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 598/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:40:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:40:30.005674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3dbb5-0fc2-4d36-b02c-f7a02ec02c37 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:30.006138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3dbb5-0fc2-4d36-b02c-f7a02ec02c37 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:30.006243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3dbb5-0fc2-4d36-b02c-f7a02ec02c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:30.026530 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a4a3dbb5-0fc2-4d36-b02c-f7a02ec02c37 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:30.027769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a4a3dbb5-0fc2-4d36-b02c-f7a02ec02c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:30.036196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 611/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:40:30.336195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7908d-d89e-401d-a331-bdcb3c75acf3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:40:30.349954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7908d-d89e-401d-a331-bdcb3c75acf3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:40:30.354208 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01653-5834-42c4-8446-034a85c40bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:40:30.354828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01653-5834-42c4-8446-034a85c40bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:30.355152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01653-5834-42c4-8446-034a85c40bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:30.355405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01653-5834-42c4-8446-034a85c40bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:30.366941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01653-5834-42c4-8446-034a85c40bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:40:30.368437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01653-5834-42c4-8446-034a85c40bd7 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:40:30.380293 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 599/1210] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:40:34.141420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc22db-a8bf-4e14-96fc-bf27527cde9c None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:34.142309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc22db-a8bf-4e14-96fc-bf27527cde9c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:34.142309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc22db-a8bf-4e14-96fc-bf27527cde9c None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:34.144420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 612/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:40:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:40:34.150289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5486c-37c9-41ee-aaa3-e49f9a3dff6f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:34.150707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5486c-37c9-41ee-aaa3-e49f9a3dff6f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:34.150815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5486c-37c9-41ee-aaa3-e49f9a3dff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:34.159810 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=81 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:34.174590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d2a5486c-37c9-41ee-aaa3-e49f9a3dff6f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:34.175843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d2a5486c-37c9-41ee-aaa3-e49f9a3dff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:34.185190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 600/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:40:34.485367 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc22db-a8bf-4e14-96fc-bf27527cde9c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:40:34.488460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9bfc22db-a8bf-4e14-96fc-bf27527cde9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:34.562568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:34.576762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc22db-a8bf-4e14-96fc-bf27527cde9c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:40:34.580464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f14b9e-d4ca-42ab-8858-d1fd28040a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:40:34.581098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f14b9e-d4ca-42ab-8858-d1fd28040a96 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:34.581374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f14b9e-d4ca-42ab-8858-d1fd28040a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:34.581632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f14b9e-d4ca-42ab-8858-d1fd28040a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:34.590599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f14b9e-d4ca-42ab-8858-d1fd28040a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:40:34.592221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f14b9e-d4ca-42ab-8858-d1fd28040a96 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:40:34.602121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 613/1213] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:40:36.739323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c3dd5-9074-4f82-978f-9f89f0e01ea6 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:36.740138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c3dd5-9074-4f82-978f-9f89f0e01ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:36.740138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c3dd5-9074-4f82-978f-9f89f0e01ea6 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:36.742074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 601/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:40:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:40:36.748248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd7fe-8ca8-4bf7-b78e-d3f124dc63a5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:36.748693 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd7fe-8ca8-4bf7-b78e-d3f124dc63a5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:36.748805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd7fe-8ca8-4bf7-b78e-d3f124dc63a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:36.772325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a50fd7fe-8ca8-4bf7-b78e-d3f124dc63a5 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:40:36.773516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a50fd7fe-8ca8-4bf7-b78e-d3f124dc63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:36.782795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 614/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:40:37.095316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c3dd5-9074-4f82-978f-9f89f0e01ea6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:40:37.098627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ff4c3dd5-9074-4f82-978f-9f89f0e01ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:40:37.118597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c3dd5-9074-4f82-978f-9f89f0e01ea6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:40:37.122600 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bedb8-7942-41f1-a664-daf163caff9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:40:37.123219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bedb8-7942-41f1-a664-daf163caff9c service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:40:37.123492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bedb8-7942-41f1-a664-daf163caff9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:40:37.123757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bedb8-7942-41f1-a664-daf163caff9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:40:37.132682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bedb8-7942-41f1-a664-daf163caff9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:40:37.134085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bedb8-7942-41f1-a664-daf163caff9c service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:40:37.143713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 602/1216] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:40:46.766525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=11 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:47.139640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=8 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:10.052274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7af68-7524-4085-b53e-1d2ad6c37915 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.053400 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7af68-7524-4085-b53e-1d2ad6c37915 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.053886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7af68-7524-4085-b53e-1d2ad6c37915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.078333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d7e7af68-7524-4085-b53e-1d2ad6c37915 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.080003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d7e7af68-7524-4085-b53e-1d2ad6c37915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.092329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 615/1217] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.102532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca106c-83a8-4abb-8101-799d80b2ca91 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.103764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca106c-83a8-4abb-8101-799d80b2ca91 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.104249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca106c-83a8-4abb-8101-799d80b2ca91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.127732 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-afca106c-83a8-4abb-8101-799d80b2ca91 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.129311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-afca106c-83a8-4abb-8101-799d80b2ca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.140587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 603/1218] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.145909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7af68-7524-4085-b53e-1d2ad6c37915 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:10.156366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7af68-7524-4085-b53e-1d2ad6c37915 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:10.167081 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b91d-a45b-4ce3-8304-5ed1387388d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:10.168015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b91d-a45b-4ce3-8304-5ed1387388d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.168641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b91d-a45b-4ce3-8304-5ed1387388d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.169116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b91d-a45b-4ce3-8304-5ed1387388d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.169965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b91d-a45b-4ce3-8304-5ed1387388d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:10.171182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b91d-a45b-4ce3-8304-5ed1387388d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:10.173098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b91d-a45b-4ce3-8304-5ed1387388d6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:10.187912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 616/1219] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:10.196166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca106c-83a8-4abb-8101-799d80b2ca91 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:10.206567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca106c-83a8-4abb-8101-799d80b2ca91 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:10.213838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45250d9d-32c8-459c-85bf-aa56f3474a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:10.214859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250d9d-32c8-459c-85bf-aa56f3474a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.215633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250d9d-32c8-459c-85bf-aa56f3474a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.216110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250d9d-32c8-459c-85bf-aa56f3474a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.216978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45250d9d-32c8-459c-85bf-aa56f3474a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:10.219402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45250d9d-32c8-459c-85bf-aa56f3474a9e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:10.278217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 604/1220] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:42:10.283111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b91d-a45b-4ce3-8304-5ed1387388d6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:10.295324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b91d-a45b-4ce3-8304-5ed1387388d6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:10.392792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2573c-4537-40ce-a652-522ce05f47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:10.393440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2573c-4537-40ce-a652-522ce05f47d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.393711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2573c-4537-40ce-a652-522ce05f47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.393974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2573c-4537-40ce-a652-522ce05f47d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.394626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2573c-4537-40ce-a652-522ce05f47d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:10.402952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2573c-4537-40ce-a652-522ce05f47d5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:10.442102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 617/1221] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:10.446149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45250d9d-32c8-459c-85bf-aa56f3474a9e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:10.457580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45250d9d-32c8-459c-85bf-aa56f3474a9e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:10.468026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200107dd-705c-4ce6-a67d-5c9af35f083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:10.468652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200107dd-705c-4ce6-a67d-5c9af35f083e admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.468927 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200107dd-705c-4ce6-a67d-5c9af35f083e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.469187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200107dd-705c-4ce6-a67d-5c9af35f083e admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.469835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200107dd-705c-4ce6-a67d-5c9af35f083e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:10.472076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200107dd-705c-4ce6-a67d-5c9af35f083e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:10.490315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 605/1222] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:10.494443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2573c-4537-40ce-a652-522ce05f47d5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:10.508366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2573c-4537-40ce-a652-522ce05f47d5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:10.518505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b179d6-9fe2-4146-8333-7653eaa68d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:10.519138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b179d6-9fe2-4146-8333-7653eaa68d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.519410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b179d6-9fe2-4146-8333-7653eaa68d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.519901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b179d6-9fe2-4146-8333-7653eaa68d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.520541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b179d6-9fe2-4146-8333-7653eaa68d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:10.522239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b179d6-9fe2-4146-8333-7653eaa68d9f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:10.534308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 618/1223] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:10.538569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200107dd-705c-4ce6-a67d-5c9af35f083e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:10.549410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200107dd-705c-4ce6-a67d-5c9af35f083e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:10.560428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc240f-2e46-4863-bce7-7dde9f862c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:10.561140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc240f-2e46-4863-bce7-7dde9f862c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.561416 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc240f-2e46-4863-bce7-7dde9f862c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.561686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc240f-2e46-4863-bce7-7dde9f862c0c admin admin] PATH_INFO: `/v3/projects/bc17b178deb64cee8c33060fe19608eb/users/59706abd14944c648378688abaac199d/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.584258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc240f-2e46-4863-bce7-7dde9f862c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc17b178deb64cee8c33060fe19608eb, user_id=59706abd14944c648378688abaac199d, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:10.586822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc240f-2e46-4863-bce7-7dde9f862c0c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:10.617888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 606/1224] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:10 2022] PUT /identity/v3/projects/bc17b178deb64cee8c33060fe19608eb/users/59706abd14944c648378688abaac199d/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:10.622947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3d392-23fe-4118-9dbb-0f3a893b0813 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.623234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3d392-23fe-4118-9dbb-0f3a893b0813 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.623830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3d392-23fe-4118-9dbb-0f3a893b0813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.651208 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-57f3d392-23fe-4118-9dbb-0f3a893b0813 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.652426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-57f3d392-23fe-4118-9dbb-0f3a893b0813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.695649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f0b75-fcf2-4460-9726-1b42e5caf5ad None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.695913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f0b75-fcf2-4460-9726-1b42e5caf5ad None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.696183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f0b75-fcf2-4460-9726-1b42e5caf5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.738657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d02f0b75-fcf2-4460-9726-1b42e5caf5ad None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.742552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d02f0b75-fcf2-4460-9726-1b42e5caf5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.773561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 619/1225] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.775509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b541a-5d31-4d08-ae88-475893f42f3c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.775792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b541a-5d31-4d08-ae88-475893f42f3c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.776062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b541a-5d31-4d08-ae88-475893f42f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.807947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-de6b541a-5d31-4d08-ae88-475893f42f3c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.809929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-de6b541a-5d31-4d08-ae88-475893f42f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.823010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 620/1226] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.824543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae775efd-88f1-410d-bd75-9b748a952db0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.824822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae775efd-88f1-410d-bd75-9b748a952db0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.825094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae775efd-88f1-410d-bd75-9b748a952db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.841890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 607/1227] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.843294 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d87c-9861-4b36-913b-02e952143576 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.843631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d87c-9861-4b36-913b-02e952143576 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.843965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d87c-9861-4b36-913b-02e952143576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.851562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ae775efd-88f1-410d-bd75-9b748a952db0 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.852862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ae775efd-88f1-410d-bd75-9b748a952db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.861223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 621/1228] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.862110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae775efd-88f1-410d-bd75-9b748a952db0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:10.864666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a2e5d87c-9861-4b36-913b-02e952143576 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.866238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a2e5d87c-9861-4b36-913b-02e952143576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.875658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 608/1229] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.880533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20be609-2003-4e2d-870b-6be292b88c5c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.880672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20be609-2003-4e2d-870b-6be292b88c5c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.882187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20be609-2003-4e2d-870b-6be292b88c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.901740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d20be609-2003-4e2d-870b-6be292b88c5c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.902986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d20be609-2003-4e2d-870b-6be292b88c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.912450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 609/1230] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.914058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe894f-4725-430d-ae4f-6a24e5398cc9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.914332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe894f-4725-430d-ae4f-6a24e5398cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.914595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe894f-4725-430d-ae4f-6a24e5398cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.933269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:10.938514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae775efd-88f1-410d-bd75-9b748a952db0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:10.942124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-66fe894f-4725-430d-ae4f-6a24e5398cc9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.943268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a32455-7367-4485-98a6-5fded004a624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:10.943422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-66fe894f-4725-430d-ae4f-6a24e5398cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.944366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a32455-7367-4485-98a6-5fded004a624 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.944891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a32455-7367-4485-98a6-5fded004a624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.945496 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a32455-7367-4485-98a6-5fded004a624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.951700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 610/1231] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.953065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6c198-e015-49a9-ad32-f2262e0a3965 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.953346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6c198-e015-49a9-ad32-f2262e0a3965 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.953617 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6c198-e015-49a9-ad32-f2262e0a3965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.954785 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a32455-7367-4485-98a6-5fded004a624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:10.956256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a32455-7367-4485-98a6-5fded004a624 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:10.966046 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 622/1232] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:10.967532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823454f1-350d-4c69-b41f-784131f390ce None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.967532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823454f1-350d-4c69-b41f-784131f390ce None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.967843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823454f1-350d-4c69-b41f-784131f390ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.976183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a5e6c198-e015-49a9-ad32-f2262e0a3965 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.977408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a5e6c198-e015-49a9-ad32-f2262e0a3965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:10.985746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 611/1233] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:10.988230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8cef3-9129-42dd-b0e9-dfcf75246ff2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:10.988824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8cef3-9129-42dd-b0e9-dfcf75246ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:10.989633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8cef3-9129-42dd-b0e9-dfcf75246ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:10.989744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-823454f1-350d-4c69-b41f-784131f390ce None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:10.990889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-823454f1-350d-4c69-b41f-784131f390ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:11.002779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 623/1234] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:11.002779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9adbf6-ca2b-4d13-876d-64b3a43244eb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.002779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9adbf6-ca2b-4d13-876d-64b3a43244eb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.002779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9adbf6-ca2b-4d13-876d-64b3a43244eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.017803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-96e8cef3-9129-42dd-b0e9-dfcf75246ff2 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:11.019062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96e8cef3-9129-42dd-b0e9-dfcf75246ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:11.020765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9c9adbf6-ca2b-4d13-876d-64b3a43244eb None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:11.022031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9c9adbf6-ca2b-4d13-876d-64b3a43244eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:11.027420 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 612/1235] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:11.030754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 624/1236] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:11.032102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cadb8f-ee85-4153-bfa2-429e0cac992c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.032386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cadb8f-ee85-4153-bfa2-429e0cac992c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.032666 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cadb8f-ee85-4153-bfa2-429e0cac992c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.032771 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca86b-416a-4f98-8058-de20d88b899f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.032957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca86b-416a-4f98-8058-de20d88b899f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.033207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca86b-416a-4f98-8058-de20d88b899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.053022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-84cadb8f-ee85-4153-bfa2-429e0cac992c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:11.054230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-84cadb8f-ee85-4153-bfa2-429e0cac992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:11.054638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0acca86b-416a-4f98-8058-de20d88b899f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:11.055850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0acca86b-416a-4f98-8058-de20d88b899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:11.070946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 625/1237] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:11.070946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be3eb-069d-4531-aab0-48099a1c93ad None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.070946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be3eb-069d-4531-aab0-48099a1c93ad None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.070946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be3eb-069d-4531-aab0-48099a1c93ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.071411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 613/1238] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:11.071411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acca86b-416a-4f98-8058-de20d88b899f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.081154 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acca86b-416a-4f98-8058-de20d88b899f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.089726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-669be3eb-069d-4531-aab0-48099a1c93ad None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:11.091077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-669be3eb-069d-4531-aab0-48099a1c93ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:11.099214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.099500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 626/1239] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:11.100353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.100506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be3eb-069d-4531-aab0-48099a1c93ad None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.100649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.101036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.101706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:11.102011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.103039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:42:11.103039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: warnings.warn(msg) Oct 24 13:42:11.103039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: Oct 24 13:42:11.103940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.111287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be3eb-069d-4531-aab0-48099a1c93ad None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.116820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c793511-c20e-40b9-a023-0c569da5ff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.117836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c793511-c20e-40b9-a023-0c569da5ff05 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.118321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c793511-c20e-40b9-a023-0c569da5ff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.118759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c793511-c20e-40b9-a023-0c569da5ff05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.119419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c793511-c20e-40b9-a023-0c569da5ff05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:11.119843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c793511-c20e-40b9-a023-0c569da5ff05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.120761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 614/1240] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:11.121790 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c793511-c20e-40b9-a023-0c569da5ff05 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.121963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.135344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 627/1241] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:11.138640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e05771-09ab-47e4-b4d5-075bd73d9db1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.139652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c793511-c20e-40b9-a023-0c569da5ff05 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.144935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49299864-fcae-4baf-91d2-fd18c78ea215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.145536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299864-fcae-4baf-91d2-fd18c78ea215 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.145905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299864-fcae-4baf-91d2-fd18c78ea215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.146633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299864-fcae-4baf-91d2-fd18c78ea215 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.147356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49299864-fcae-4baf-91d2-fd18c78ea215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:11.148213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49299864-fcae-4baf-91d2-fd18c78ea215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.149346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49299864-fcae-4baf-91d2-fd18c78ea215 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.151948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c793511-c20e-40b9-a023-0c569da5ff05 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.157546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb74811-3db9-499f-9066-64e47ee0fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.158163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb74811-3db9-499f-9066-64e47ee0fd94 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.158436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb74811-3db9-499f-9066-64e47ee0fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.158700 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb74811-3db9-499f-9066-64e47ee0fd94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.159679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb74811-3db9-499f-9066-64e47ee0fd94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:11.159819 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb74811-3db9-499f-9066-64e47ee0fd94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.161452 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb74811-3db9-499f-9066-64e47ee0fd94 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.162763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 615/1242] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:11.163409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49299864-fcae-4baf-91d2-fd18c78ea215 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.174482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49299864-fcae-4baf-91d2-fd18c78ea215 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.179105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68748d2-9dad-42bc-9fee-436ab42f32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.179711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68748d2-9dad-42bc-9fee-436ab42f32ed admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.179978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68748d2-9dad-42bc-9fee-436ab42f32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.180251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68748d2-9dad-42bc-9fee-436ab42f32ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.180959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 628/1243] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:11.182685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da136778-8463-40a3-83d6-72de784b8abe None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.182985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da136778-8463-40a3-83d6-72de784b8abe None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.183263 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da136778-8463-40a3-83d6-72de784b8abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.187174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68748d2-9dad-42bc-9fee-436ab42f32ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:11.187535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68748d2-9dad-42bc-9fee-436ab42f32ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.189540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68748d2-9dad-42bc-9fee-436ab42f32ed admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.203938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 616/1244] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:11.204918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68748d2-9dad-42bc-9fee-436ab42f32ed admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.206995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-da136778-8463-40a3-83d6-72de784b8abe None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:11.208204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-da136778-8463-40a3-83d6-72de784b8abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:11.217417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 629/1245] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:11.218736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da136778-8463-40a3-83d6-72de784b8abe None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.223176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68748d2-9dad-42bc-9fee-436ab42f32ed admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.228814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cacca-8aa1-4645-940c-1f2e577171fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.228981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da136778-8463-40a3-83d6-72de784b8abe None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.229457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cacca-8aa1-4645-940c-1f2e577171fe admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.229758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cacca-8aa1-4645-940c-1f2e577171fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.230112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cacca-8aa1-4645-940c-1f2e577171fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.230760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cacca-8aa1-4645-940c-1f2e577171fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:11.231105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cacca-8aa1-4645-940c-1f2e577171fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.233251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cacca-8aa1-4645-940c-1f2e577171fe admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.233780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f361ac-a231-4d5e-99af-5680c840de6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.234520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f361ac-a231-4d5e-99af-5680c840de6a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.234800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f361ac-a231-4d5e-99af-5680c840de6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.235101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f361ac-a231-4d5e-99af-5680c840de6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.235732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f361ac-a231-4d5e-99af-5680c840de6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.236758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-b2f361ac-a231-4d5e-99af-5680c840de6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:42:11.236758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: warnings.warn(msg) Oct 24 13:42:11.236758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: Oct 24 13:42:11.237310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:11.238283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f361ac-a231-4d5e-99af-5680c840de6a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.258360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 617/1246] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:11.258360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cacca-8aa1-4645-940c-1f2e577171fe admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.265342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cacca-8aa1-4645-940c-1f2e577171fe admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.270833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb0da-8bfb-48e5-8bd6-94047a85e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.271335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb0da-8bfb-48e5-8bd6-94047a85e033 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.271653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb0da-8bfb-48e5-8bd6-94047a85e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.271861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb0da-8bfb-48e5-8bd6-94047a85e033 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.272879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bb0da-8bfb-48e5-8bd6-94047a85e033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.274891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bb0da-8bfb-48e5-8bd6-94047a85e033 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.288423 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 630/1247] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.290056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f361ac-a231-4d5e-99af-5680c840de6a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.308444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 618/1248] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.312805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb0da-8bfb-48e5-8bd6-94047a85e033 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.368940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f361ac-a231-4d5e-99af-5680c840de6a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.383982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb0da-8bfb-48e5-8bd6-94047a85e033 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.389358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b925f1e-e147-42f5-a42f-706a0eb8bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.390825 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b925f1e-e147-42f5-a42f-706a0eb8bce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.391163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b925f1e-e147-42f5-a42f-706a0eb8bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.391851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b925f1e-e147-42f5-a42f-706a0eb8bce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.392514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b925f1e-e147-42f5-a42f-706a0eb8bce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.394423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b925f1e-e147-42f5-a42f-706a0eb8bce4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.426428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 619/1249] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.427828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b925f1e-e147-42f5-a42f-706a0eb8bce4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.443900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bf1d6-01c6-4753-bbcf-926ad38b3303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.444515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bf1d6-01c6-4753-bbcf-926ad38b3303 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.444792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bf1d6-01c6-4753-bbcf-926ad38b3303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.445375 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bf1d6-01c6-4753-bbcf-926ad38b3303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.446092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bf1d6-01c6-4753-bbcf-926ad38b3303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.449135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bf1d6-01c6-4753-bbcf-926ad38b3303 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.477821 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:11.488189 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 631/1250] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.489071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bf1d6-01c6-4753-bbcf-926ad38b3303 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.512489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b925f1e-e147-42f5-a42f-706a0eb8bce4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.572582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bf1d6-01c6-4753-bbcf-926ad38b3303 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.577564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8209-2058-4e47-a33f-ef89c2c7584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.578185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8209-2058-4e47-a33f-ef89c2c7584d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.578464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8209-2058-4e47-a33f-ef89c2c7584d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.578736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8209-2058-4e47-a33f-ef89c2c7584d admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.579564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f8209-2058-4e47-a33f-ef89c2c7584d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:11.579987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f8209-2058-4e47-a33f-ef89c2c7584d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.581496 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f8209-2058-4e47-a33f-ef89c2c7584d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.592777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232556d4-4ecb-47e6-ba92-ca3ec4d88ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.593858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232556d4-4ecb-47e6-ba92-ca3ec4d88ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.594229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232556d4-4ecb-47e6-ba92-ca3ec4d88ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.594588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232556d4-4ecb-47e6-ba92-ca3ec4d88ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.595380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232556d4-4ecb-47e6-ba92-ca3ec4d88ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.595629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 632/1251] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:11.595629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8209-2058-4e47-a33f-ef89c2c7584d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.603204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232556d4-4ecb-47e6-ba92-ca3ec4d88ff4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.614250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8209-2058-4e47-a33f-ef89c2c7584d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.614465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:11.619791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33046129-2e7f-44bc-8662-55de6679ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.620648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33046129-2e7f-44bc-8662-55de6679ca84 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.620834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33046129-2e7f-44bc-8662-55de6679ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.621183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33046129-2e7f-44bc-8662-55de6679ca84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.621891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33046129-2e7f-44bc-8662-55de6679ca84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.623985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33046129-2e7f-44bc-8662-55de6679ca84 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.635701 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 620/1252] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/projects => generated 389 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.636425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232556d4-4ecb-47e6-ba92-ca3ec4d88ff4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.658097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 633/1253] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.659774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33046129-2e7f-44bc-8662-55de6679ca84 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.704016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232556d4-4ecb-47e6-ba92-ca3ec4d88ff4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.734400 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33046129-2e7f-44bc-8662-55de6679ca84 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.738252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f43f6b-f3a8-4ea5-80ce-efec71410781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.738865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f43f6b-f3a8-4ea5-80ce-efec71410781 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.739167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f43f6b-f3a8-4ea5-80ce-efec71410781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.739431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f43f6b-f3a8-4ea5-80ce-efec71410781 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.740053 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f43f6b-f3a8-4ea5-80ce-efec71410781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.742034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f43f6b-f3a8-4ea5-80ce-efec71410781 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.774804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 634/1254] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.775037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fede5b-bc1a-4850-8b99-14f7d46ac8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.775037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fede5b-bc1a-4850-8b99-14f7d46ac8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.775037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fede5b-bc1a-4850-8b99-14f7d46ac8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.775037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fede5b-bc1a-4850-8b99-14f7d46ac8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.775417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fede5b-bc1a-4850-8b99-14f7d46ac8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.775502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-18fede5b-bc1a-4850-8b99-14f7d46ac8e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:42:11.775502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: warnings.warn(msg) Oct 24 13:42:11.775502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: Oct 24 13:42:11.776687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fede5b-bc1a-4850-8b99-14f7d46ac8e2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.777090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f43f6b-f3a8-4ea5-80ce-efec71410781 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.791436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f43f6b-f3a8-4ea5-80ce-efec71410781 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.796866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b8b92-ff52-4910-978a-b70da7240cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.797550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b8b92-ff52-4910-978a-b70da7240cab admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.797781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b8b92-ff52-4910-978a-b70da7240cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.798055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b8b92-ff52-4910-978a-b70da7240cab admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.800399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b8b92-ff52-4910-978a-b70da7240cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.801580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b8b92-ff52-4910-978a-b70da7240cab admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.804165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 621/1255] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.805219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fede5b-bc1a-4850-8b99-14f7d46ac8e2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.817417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fede5b-bc1a-4850-8b99-14f7d46ac8e2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.823686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc76aa-e449-4e56-a6d6-0d66826da0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.824473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc76aa-e449-4e56-a6d6-0d66826da0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.824836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc76aa-e449-4e56-a6d6-0d66826da0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.825198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc76aa-e449-4e56-a6d6-0d66826da0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.825975 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc76aa-e449-4e56-a6d6-0d66826da0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.830185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 635/1256] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/users => generated 287 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.831179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b8b92-ff52-4910-978a-b70da7240cab admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.833904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc76aa-e449-4e56-a6d6-0d66826da0f2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.842840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b8b92-ff52-4910-978a-b70da7240cab admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.849190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73501da8-d0ef-4cc9-9376-f15fb98ad675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.849908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73501da8-d0ef-4cc9-9376-f15fb98ad675 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.850302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73501da8-d0ef-4cc9-9376-f15fb98ad675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.850578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73501da8-d0ef-4cc9-9376-f15fb98ad675 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.851382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73501da8-d0ef-4cc9-9376-f15fb98ad675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.855008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73501da8-d0ef-4cc9-9376-f15fb98ad675 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.867103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 622/1257] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/users => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.867103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc76aa-e449-4e56-a6d6-0d66826da0f2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.878861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc76aa-e449-4e56-a6d6-0d66826da0f2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.884184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9579e-812f-486b-82ea-f5cf7062151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:11.885038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9579e-812f-486b-82ea-f5cf7062151a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:11.885513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9579e-812f-486b-82ea-f5cf7062151a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:11.885957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9579e-812f-486b-82ea-f5cf7062151a admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:11.886681 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9579e-812f-486b-82ea-f5cf7062151a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:11.889428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9579e-812f-486b-82ea-f5cf7062151a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:11.892794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 636/1258] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.893892 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73501da8-d0ef-4cc9-9376-f15fb98ad675 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.927665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 623/1259] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/users => generated 295 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:11.929197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9579e-812f-486b-82ea-f5cf7062151a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:11.934110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:11.947465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9579e-812f-486b-82ea-f5cf7062151a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:11.995085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73501da8-d0ef-4cc9-9376-f15fb98ad675 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.000996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ba8a4-70a7-43ec-95a0-a387ddefbcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.001955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ba8a4-70a7-43ec-95a0-a387ddefbcbd admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.002329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ba8a4-70a7-43ec-95a0-a387ddefbcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.002670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ba8a4-70a7-43ec-95a0-a387ddefbcbd admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.003470 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ba8a4-70a7-43ec-95a0-a387ddefbcbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.005572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ba8a4-70a7-43ec-95a0-a387ddefbcbd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.019748 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:12.030491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ee0f8-6856-4d52-9b8f-01cd43ee58cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.031315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee0f8-6856-4d52-9b8f-01cd43ee58cd admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.031756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee0f8-6856-4d52-9b8f-01cd43ee58cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.032182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee0f8-6856-4d52-9b8f-01cd43ee58cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.032834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ee0f8-6856-4d52-9b8f-01cd43ee58cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.034761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ee0f8-6856-4d52-9b8f-01cd43ee58cd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.036055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 637/1260] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:11 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:12.037080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ba8a4-70a7-43ec-95a0-a387ddefbcbd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.048711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ba8a4-70a7-43ec-95a0-a387ddefbcbd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.050892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 624/1261] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.051954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ee0f8-6856-4d52-9b8f-01cd43ee58cd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.054492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832c990-c2a2-4930-9cff-a0030f5109af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.055248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c990-c2a2-4930-9cff-a0030f5109af admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.055625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c990-c2a2-4930-9cff-a0030f5109af admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.056004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c990-c2a2-4930-9cff-a0030f5109af admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.056749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832c990-c2a2-4930-9cff-a0030f5109af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.059001 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832c990-c2a2-4930-9cff-a0030f5109af admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.063860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ee0f8-6856-4d52-9b8f-01cd43ee58cd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.070483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357760-9fd0-41ac-b151-8d0989cf5e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.071229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357760-9fd0-41ac-b151-8d0989cf5e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.071570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357760-9fd0-41ac-b151-8d0989cf5e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.071897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357760-9fd0-41ac-b151-8d0989cf5e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.072599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71357760-9fd0-41ac-b151-8d0989cf5e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.076219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 638/1262] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.076219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832c990-c2a2-4930-9cff-a0030f5109af admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.076465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71357760-9fd0-41ac-b151-8d0989cf5e7a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.085578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832c990-c2a2-4930-9cff-a0030f5109af admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.091796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c932d-2a25-4854-9b96-264013852014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.092014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 625/1263] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.092869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c932d-2a25-4854-9b96-264013852014 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.093499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c932d-2a25-4854-9b96-264013852014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.093777 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c932d-2a25-4854-9b96-264013852014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.094428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c932d-2a25-4854-9b96-264013852014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.096116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c932d-2a25-4854-9b96-264013852014 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.096969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357760-9fd0-41ac-b151-8d0989cf5e7a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.111534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 639/1264] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.112679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c932d-2a25-4854-9b96-264013852014 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.115523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357760-9fd0-41ac-b151-8d0989cf5e7a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.122108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852fb27-abc7-46f6-9daf-13c287fabadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.122853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852fb27-abc7-46f6-9daf-13c287fabadc admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.123217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852fb27-abc7-46f6-9daf-13c287fabadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.123561 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852fb27-abc7-46f6-9daf-13c287fabadc admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.124325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852fb27-abc7-46f6-9daf-13c287fabadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.125220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c932d-2a25-4854-9b96-264013852014 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.126524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852fb27-abc7-46f6-9daf-13c287fabadc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.132502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91499368-d348-4fe3-96a5-65d0e7ba6407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.133265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91499368-d348-4fe3-96a5-65d0e7ba6407 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.133541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91499368-d348-4fe3-96a5-65d0e7ba6407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.133963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91499368-d348-4fe3-96a5-65d0e7ba6407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.134619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91499368-d348-4fe3-96a5-65d0e7ba6407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.136582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91499368-d348-4fe3-96a5-65d0e7ba6407 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.150767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 640/1265] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.151844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91499368-d348-4fe3-96a5-65d0e7ba6407 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.164208 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 626/1266] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:12 2022] POST /identity/v3/users => generated 286 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:12.165658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852fb27-abc7-46f6-9daf-13c287fabadc admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.169382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91499368-d348-4fe3-96a5-65d0e7ba6407 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.175849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81de91d-c6e5-4f84-998a-5916b8d6f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.177394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852fb27-abc7-46f6-9daf-13c287fabadc admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.177517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81de91d-c6e5-4f84-998a-5916b8d6f5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.177744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81de91d-c6e5-4f84-998a-5916b8d6f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.178017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81de91d-c6e5-4f84-998a-5916b8d6f5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.178700 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81de91d-c6e5-4f84-998a-5916b8d6f5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.180968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81de91d-c6e5-4f84-998a-5916b8d6f5c6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.183187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd014f-93b8-4166-b9aa-28537e03be17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.184247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd014f-93b8-4166-b9aa-28537e03be17 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.184583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd014f-93b8-4166-b9aa-28537e03be17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.184920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd014f-93b8-4166-b9aa-28537e03be17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.185663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd014f-93b8-4166-b9aa-28537e03be17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.187446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd014f-93b8-4166-b9aa-28537e03be17 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.197984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 641/1267] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.199991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81de91d-c6e5-4f84-998a-5916b8d6f5c6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.202628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 627/1268] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.203635 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd014f-93b8-4166-b9aa-28537e03be17 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.212564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81de91d-c6e5-4f84-998a-5916b8d6f5c6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.215132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd014f-93b8-4166-b9aa-28537e03be17 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.218235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2193-296a-47bc-b676-b5de56d82f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.219191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2193-296a-47bc-b676-b5de56d82f6a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.219660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2193-296a-47bc-b676-b5de56d82f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.220091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2193-296a-47bc-b676-b5de56d82f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.220429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043615e-458d-4263-8583-6fbe123d2f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.221141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043615e-458d-4263-8583-6fbe123d2f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.221517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043615e-458d-4263-8583-6fbe123d2f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.221711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c2193-296a-47bc-b676-b5de56d82f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.221888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043615e-458d-4263-8583-6fbe123d2f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.222710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043615e-458d-4263-8583-6fbe123d2f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.223989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c2193-296a-47bc-b676-b5de56d82f6a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.224488 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043615e-458d-4263-8583-6fbe123d2f31 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.239221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 628/1269] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.239973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 642/1270] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.240213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043615e-458d-4263-8583-6fbe123d2f31 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.241126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2193-296a-47bc-b676-b5de56d82f6a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.253043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2193-296a-47bc-b676-b5de56d82f6a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.254791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043615e-458d-4263-8583-6fbe123d2f31 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.258775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb9565-fce2-47d1-b589-7d6fdcf31f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.259516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb9565-fce2-47d1-b589-7d6fdcf31f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.259793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb9565-fce2-47d1-b589-7d6fdcf31f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.260059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb9565-fce2-47d1-b589-7d6fdcf31f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.260446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf211-d49e-4883-910c-fe8fedfdcfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.260752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb9565-fce2-47d1-b589-7d6fdcf31f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.261101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf211-d49e-4883-910c-fe8fedfdcfbf admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.261373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf211-d49e-4883-910c-fe8fedfdcfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.261824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf211-d49e-4883-910c-fe8fedfdcfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.262467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdf211-d49e-4883-910c-fe8fedfdcfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.262582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb9565-fce2-47d1-b589-7d6fdcf31f1b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.264504 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdf211-d49e-4883-910c-fe8fedfdcfbf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.276207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 643/1271] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.277416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb9565-fce2-47d1-b589-7d6fdcf31f1b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.280393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 629/1272] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.281272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf211-d49e-4883-910c-fe8fedfdcfbf admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.294083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb9565-fce2-47d1-b589-7d6fdcf31f1b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.295696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf211-d49e-4883-910c-fe8fedfdcfbf admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.300911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994823e6-32f9-4303-a9ab-a737e942b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.301815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994823e6-32f9-4303-a9ab-a737e942b441 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.302221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994823e6-32f9-4303-a9ab-a737e942b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.302353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef5ccc-7123-470b-956f-d11abbeececd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.302513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994823e6-32f9-4303-a9ab-a737e942b441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.303133 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef5ccc-7123-470b-956f-d11abbeececd admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.303245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994823e6-32f9-4303-a9ab-a737e942b441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.303735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef5ccc-7123-470b-956f-d11abbeececd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.304079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef5ccc-7123-470b-956f-d11abbeececd admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.304753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994823e6-32f9-4303-a9ab-a737e942b441 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.305078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef5ccc-7123-470b-956f-d11abbeececd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.307687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef5ccc-7123-470b-956f-d11abbeececd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.316973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 644/1273] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.317705 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994823e6-32f9-4303-a9ab-a737e942b441 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.320979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 630/1274] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.322247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef5ccc-7123-470b-956f-d11abbeececd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.336909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994823e6-32f9-4303-a9ab-a737e942b441 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.342738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef5ccc-7123-470b-956f-d11abbeececd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.347590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85c01-b716-49eb-808a-3ec41b355744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.348276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85c01-b716-49eb-808a-3ec41b355744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.348553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85c01-b716-49eb-808a-3ec41b355744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.348825 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85c01-b716-49eb-808a-3ec41b355744 admin admin] PATH_INFO: `/v3/projects/6178d5d985ee4559834774f0b934ca42/users/bbb8d023efe745248117c9c51521a63e/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.358909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f84bac-6ab1-4091-9327-4072ba9f35ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.359986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f84bac-6ab1-4091-9327-4072ba9f35ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.360307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f84bac-6ab1-4091-9327-4072ba9f35ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.360830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f84bac-6ab1-4091-9327-4072ba9f35ef admin admin] PATH_INFO: `/v3/projects/83eaafb421bd4854a6a38b9b3b072c25/users/e7675c1adc824170b1c42cc955717a59/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.366714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc85c01-b716-49eb-808a-3ec41b355744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6178d5d985ee4559834774f0b934ca42, user_id=bbb8d023efe745248117c9c51521a63e, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.369498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc85c01-b716-49eb-808a-3ec41b355744 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.398805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 631/1275] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:12 2022] PUT /identity/v3/projects/6178d5d985ee4559834774f0b934ca42/users/bbb8d023efe745248117c9c51521a63e/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:12.398805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85c01-b716-49eb-808a-3ec41b355744 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.407255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f84bac-6ab1-4091-9327-4072ba9f35ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=83eaafb421bd4854a6a38b9b3b072c25, user_id=e7675c1adc824170b1c42cc955717a59, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.410647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f84bac-6ab1-4091-9327-4072ba9f35ef admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.443906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 645/1276] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:12 2022] PUT /identity/v3/projects/83eaafb421bd4854a6a38b9b3b072c25/users/e7675c1adc824170b1c42cc955717a59/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:12.445153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f84bac-6ab1-4091-9327-4072ba9f35ef admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.486646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85c01-b716-49eb-808a-3ec41b355744 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.546508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f84bac-6ab1-4091-9327-4072ba9f35ef admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.552471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e0928-53ea-45b2-a22d-64d771721dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.553153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0928-53ea-45b2-a22d-64d771721dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.553562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0928-53ea-45b2-a22d-64d771721dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.553835 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0928-53ea-45b2-a22d-64d771721dd2 admin admin] PATH_INFO: `/v3/projects/37c19412bdd84967be4262a059299ae7/users/79a2780405ee4b77a63166819c3da789/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.574317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e0928-53ea-45b2-a22d-64d771721dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c19412bdd84967be4262a059299ae7, user_id=79a2780405ee4b77a63166819c3da789, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.578514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e0928-53ea-45b2-a22d-64d771721dd2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.582621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:12.599680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeefc04-c8dc-4a15-aaba-941737cbcfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.600567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeefc04-c8dc-4a15-aaba-941737cbcfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.601043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeefc04-c8dc-4a15-aaba-941737cbcfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.601323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeefc04-c8dc-4a15-aaba-941737cbcfe8 admin admin] PATH_INFO: `/v3/projects/7416718ac3cb4301b07764d92ff0d88c/users/6414c4b3a3ca4d4bab67712790abff00/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.607096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 646/1277] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:12 2022] PUT /identity/v3/projects/37c19412bdd84967be4262a059299ae7/users/79a2780405ee4b77a63166819c3da789/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:12.609307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e0928-53ea-45b2-a22d-64d771721dd2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.611830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:12.654979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeefc04-c8dc-4a15-aaba-941737cbcfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7416718ac3cb4301b07764d92ff0d88c, user_id=6414c4b3a3ca4d4bab67712790abff00, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.659480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeefc04-c8dc-4a15-aaba-941737cbcfe8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.693564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 632/1278] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:12 2022] PUT /identity/v3/projects/7416718ac3cb4301b07764d92ff0d88c/users/6414c4b3a3ca4d4bab67712790abff00/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:12.695765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeefc04-c8dc-4a15-aaba-941737cbcfe8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.755858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e0928-53ea-45b2-a22d-64d771721dd2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.794553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeefc04-c8dc-4a15-aaba-941737cbcfe8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.802912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7a444-6ef8-4060-a858-3f1abf6fa39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.803594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a444-6ef8-4060-a858-3f1abf6fa39d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.803868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a444-6ef8-4060-a858-3f1abf6fa39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.804140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a444-6ef8-4060-a858-3f1abf6fa39d admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.805247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7a444-6ef8-4060-a858-3f1abf6fa39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.806960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7a444-6ef8-4060-a858-3f1abf6fa39d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.822028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 633/1279] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:12.823186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7a444-6ef8-4060-a858-3f1abf6fa39d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:12.835907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7a444-6ef8-4060-a858-3f1abf6fa39d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:12.843578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45b2de-5534-415f-a17e-e7ac9cfe09df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.844278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b2de-5534-415f-a17e-e7ac9cfe09df admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.844559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b2de-5534-415f-a17e-e7ac9cfe09df admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.844844 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b2de-5534-415f-a17e-e7ac9cfe09df admin admin] PATH_INFO: `/v3/projects/7a94849f13944b45a3500937b6af40d3/users/447498c7fe844b5d8cc616d71c3ff7f8/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.859046 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe234a-d884-44d1-92d4-a12d10f8030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:12.859728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe234a-d884-44d1-92d4-a12d10f8030f admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.859995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe234a-d884-44d1-92d4-a12d10f8030f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.860269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe234a-d884-44d1-92d4-a12d10f8030f admin admin] PATH_INFO: `/v3/projects/867bbec9e6c74c43b064e79b1adbe575/users/52d8410aace14d04848ada4f2bff174a/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.865118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b2de-5534-415f-a17e-e7ac9cfe09df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a94849f13944b45a3500937b6af40d3, user_id=447498c7fe844b5d8cc616d71c3ff7f8, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.868263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b2de-5534-415f-a17e-e7ac9cfe09df admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.876472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe234a-d884-44d1-92d4-a12d10f8030f admin admin] RBAC: Authorizing `identity:create_grant(project_id=867bbec9e6c74c43b064e79b1adbe575, user_id=52d8410aace14d04848ada4f2bff174a, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:12.879202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe234a-d884-44d1-92d4-a12d10f8030f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:12.885098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 634/1280] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:12 2022] PUT /identity/v3/projects/7a94849f13944b45a3500937b6af40d3/users/447498c7fe844b5d8cc616d71c3ff7f8/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:12.886385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396513-6df3-41bd-b6bf-93b5405fcd20 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.886679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396513-6df3-41bd-b6bf-93b5405fcd20 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.887027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396513-6df3-41bd-b6bf-93b5405fcd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.908448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 647/1281] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:12 2022] PUT /identity/v3/projects/867bbec9e6c74c43b064e79b1adbe575/users/52d8410aace14d04848ada4f2bff174a/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:12.908448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef0211-8a47-48f1-9e21-14de8edc4264 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:12.908448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef0211-8a47-48f1-9e21-14de8edc4264 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:12.908448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef0211-8a47-48f1-9e21-14de8edc4264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:12.933014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a5396513-6df3-41bd-b6bf-93b5405fcd20 None None] MFA Rules not processed for user `bbb8d023efe745248117c9c51521a63e`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:12.934902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a5396513-6df3-41bd-b6bf-93b5405fcd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:12.945676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6aef0211-8a47-48f1-9e21-14de8edc4264 None None] MFA Rules not processed for user `e7675c1adc824170b1c42cc955717a59`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:12.947369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6aef0211-8a47-48f1-9e21-14de8edc4264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:13.044218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 648/1282] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:13.046627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc1c0e-61e2-4655-ba37-870098a68f34 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.047239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc1c0e-61e2-4655-ba37-870098a68f34 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.047696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc1c0e-61e2-4655-ba37-870098a68f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.072730 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 635/1283] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:13.073909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accd7ab-9979-4c61-ba55-0974e4932b9e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.074187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accd7ab-9979-4c61-ba55-0974e4932b9e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.075520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accd7ab-9979-4c61-ba55-0974e4932b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.077545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-11dc1c0e-61e2-4655-ba37-870098a68f34 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:13.079621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-11dc1c0e-61e2-4655-ba37-870098a68f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:13.091610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:13.098228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5accd7ab-9979-4c61-ba55-0974e4932b9e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:13.099770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5accd7ab-9979-4c61-ba55-0974e4932b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:13.156543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:13.158630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 649/1284] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:13.159471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc1c0e-61e2-4655-ba37-870098a68f34 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.169591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc1c0e-61e2-4655-ba37-870098a68f34 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.175676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57903ab5-9276-40e7-bedd-b5cf3f37c655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.176352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903ab5-9276-40e7-bedd-b5cf3f37c655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.176736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903ab5-9276-40e7-bedd-b5cf3f37c655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.176921 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903ab5-9276-40e7-bedd-b5cf3f37c655 admin admin] PATH_INFO: `/v3/projects/3d33b787112841fe92b3d1a253838e7d/users/4d8d857b78ca42c6a1080c3fe41fb22f/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.182403 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 636/1285] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:13.183544 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3cd7-089c-4495-8d02-94adab673203 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.183820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3cd7-089c-4495-8d02-94adab673203 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.184085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3cd7-089c-4495-8d02-94adab673203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.194407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57903ab5-9276-40e7-bedd-b5cf3f37c655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d33b787112841fe92b3d1a253838e7d, user_id=4d8d857b78ca42c6a1080c3fe41fb22f, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.196923 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57903ab5-9276-40e7-bedd-b5cf3f37c655 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.205772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d0ab3cd7-089c-4495-8d02-94adab673203 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:13.207088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d0ab3cd7-089c-4495-8d02-94adab673203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:13.216934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 650/1286] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:13 2022] PUT /identity/v3/projects/3d33b787112841fe92b3d1a253838e7d/users/4d8d857b78ca42c6a1080c3fe41fb22f/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:13.225825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8294d0-f139-4ba6-8c68-fbe2e9b8fa86 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.226310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8294d0-f139-4ba6-8c68-fbe2e9b8fa86 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.226979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8294d0-f139-4ba6-8c68-fbe2e9b8fa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.249269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7a8294d0-f139-4ba6-8c68-fbe2e9b8fa86 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:13.250507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7a8294d0-f139-4ba6-8c68-fbe2e9b8fa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:13.274945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 637/1287] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:13.278708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab3cd7-089c-4495-8d02-94adab673203 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.296023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab3cd7-089c-4495-8d02-94adab673203 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.300890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2190d-0b48-4f42-9925-cb1fcf14bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.301825 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2190d-0b48-4f42-9925-cb1fcf14bfa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.302108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2190d-0b48-4f42-9925-cb1fcf14bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.302371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2190d-0b48-4f42-9925-cb1fcf14bfa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.303073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2190d-0b48-4f42-9925-cb1fcf14bfa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.304969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2190d-0b48-4f42-9925-cb1fcf14bfa4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.317157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 651/1288] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:13.317157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8294d0-f139-4ba6-8c68-fbe2e9b8fa86 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.330033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8294d0-f139-4ba6-8c68-fbe2e9b8fa86 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.337119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0554-7086-4fff-b4ea-cd06aaa47233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.337772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0554-7086-4fff-b4ea-cd06aaa47233 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.338309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0554-7086-4fff-b4ea-cd06aaa47233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.338582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0554-7086-4fff-b4ea-cd06aaa47233 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.339408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0554-7086-4fff-b4ea-cd06aaa47233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.342020 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0554-7086-4fff-b4ea-cd06aaa47233 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.347155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 638/1289] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:13.348105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2190d-0b48-4f42-9925-cb1fcf14bfa4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.349708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-89c2190d-0b48-4f42-9925-cb1fcf14bfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:13.389301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 652/1290] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:13.390219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0554-7086-4fff-b4ea-cd06aaa47233 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.395318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-61ab0554-7086-4fff-b4ea-cd06aaa47233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:13.415504 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2190d-0b48-4f42-9925-cb1fcf14bfa4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.458544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0554-7086-4fff-b4ea-cd06aaa47233 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.462403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28db07-06b0-48be-885a-8bcd9b617687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.463041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28db07-06b0-48be-885a-8bcd9b617687 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.463320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28db07-06b0-48be-885a-8bcd9b617687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.463583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28db07-06b0-48be-885a-8bcd9b617687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.475171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8b57d-a158-4f9d-830c-542421b681dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.476248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8b57d-a158-4f9d-830c-542421b681dd service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.476774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8b57d-a158-4f9d-830c-542421b681dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.476935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8b57d-a158-4f9d-830c-542421b681dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.488002 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:13.518147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:13.535136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28db07-06b0-48be-885a-8bcd9b617687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.537364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28db07-06b0-48be-885a-8bcd9b617687 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.550408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 653/1291] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:13.551795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917cd37-4f3e-4f20-ae06-e4c5e5430433 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.552277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917cd37-4f3e-4f20-ae06-e4c5e5430433 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.552548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917cd37-4f3e-4f20-ae06-e4c5e5430433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.555221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8b57d-a158-4f9d-830c-542421b681dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.556890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8b57d-a158-4f9d-830c-542421b681dd service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.570957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 639/1292] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:13.572841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8b57d-a158-4f9d-830c-542421b681dd service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.583168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8b57d-a158-4f9d-830c-542421b681dd service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.590140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0917cd37-4f3e-4f20-ae06-e4c5e5430433 None None] MFA Rules not processed for user `4d8d857b78ca42c6a1080c3fe41fb22f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:13.591359 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff9e50-57de-43b7-95b1-59420268c5a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.591984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff9e50-57de-43b7-95b1-59420268c5a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.592343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff9e50-57de-43b7-95b1-59420268c5a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.592637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff9e50-57de-43b7-95b1-59420268c5a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.595247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0917cd37-4f3e-4f20-ae06-e4c5e5430433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:13.612089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff9e50-57de-43b7-95b1-59420268c5a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.613536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff9e50-57de-43b7-95b1-59420268c5a2 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.625851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 640/1293] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:13.626947 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff9e50-57de-43b7-95b1-59420268c5a2 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.637259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff9e50-57de-43b7-95b1-59420268c5a2 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.649603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf073190-2166-4848-b8de-54205ea6db89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.650358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf073190-2166-4848-b8de-54205ea6db89 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.650631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf073190-2166-4848-b8de-54205ea6db89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.650894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf073190-2166-4848-b8de-54205ea6db89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.674107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf073190-2166-4848-b8de-54205ea6db89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.675656 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf073190-2166-4848-b8de-54205ea6db89 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.701105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 641/1294] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:13.702073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf073190-2166-4848-b8de-54205ea6db89 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.713709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf073190-2166-4848-b8de-54205ea6db89 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.719014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 654/1295] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:13.719014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917cd37-4f3e-4f20-ae06-e4c5e5430433 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.722882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a88081-5949-406f-b416-52ec0c20491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.723774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a88081-5949-406f-b416-52ec0c20491c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.726257 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a88081-5949-406f-b416-52ec0c20491c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.726682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a88081-5949-406f-b416-52ec0c20491c admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.727497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a88081-5949-406f-b416-52ec0c20491c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.728626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917cd37-4f3e-4f20-ae06-e4c5e5430433 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.735436 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a88081-5949-406f-b416-52ec0c20491c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.740358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bb4d7-1bc9-4390-81cd-f68fc532f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.741164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb4d7-1bc9-4390-81cd-f68fc532f842 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.741590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb4d7-1bc9-4390-81cd-f68fc532f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.741892 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb4d7-1bc9-4390-81cd-f68fc532f842 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.742654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bb4d7-1bc9-4390-81cd-f68fc532f842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.744859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bb4d7-1bc9-4390-81cd-f68fc532f842 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.783726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 655/1296] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/users => generated 293 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:13.788705 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6124-2c6b-4da6-86f1-0c442462423e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.789801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6124-2c6b-4da6-86f1-0c442462423e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.792596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6124-2c6b-4da6-86f1-0c442462423e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.796955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 642/1297] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:13.797639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a88081-5949-406f-b416-52ec0c20491c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.798148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 656/1298] 10.222.0.46 () {54 vars in 961 bytes} [Mon Oct 24 13:42:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:42:13.800253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6124-2c6b-4da6-86f1-0c442462423e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.818571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a88081-5949-406f-b416-52ec0c20491c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.824790 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6124-2c6b-4da6-86f1-0c442462423e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.827408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe857-8232-4957-8c62-c6e20cca2ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.828486 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe857-8232-4957-8c62-c6e20cca2ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.828903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe857-8232-4957-8c62-c6e20cca2ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.829260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe857-8232-4957-8c62-c6e20cca2ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.830045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe857-8232-4957-8c62-c6e20cca2ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.832546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe857-8232-4957-8c62-c6e20cca2ba9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.834445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d122a2-d401-4b62-8873-36a5e6b2e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.836155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d122a2-d401-4b62-8873-36a5e6b2e983 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.836884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d122a2-d401-4b62-8873-36a5e6b2e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.837936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d122a2-d401-4b62-8873-36a5e6b2e983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.839247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d122a2-d401-4b62-8873-36a5e6b2e983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.843050 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d122a2-d401-4b62-8873-36a5e6b2e983 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.857948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 643/1299] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:13.858863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f5f99-bf2d-4e25-8595-c14ee82a2999 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.859429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f5f99-bf2d-4e25-8595-c14ee82a2999 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.864164 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f5f99-bf2d-4e25-8595-c14ee82a2999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.871247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 657/1300] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:13.872654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d122a2-d401-4b62-8873-36a5e6b2e983 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.886798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d122a2-d401-4b62-8873-36a5e6b2e983 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:13.893341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46544dee-4c45-4f3a-9846-960a934b8e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:13.894397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46544dee-4c45-4f3a-9846-960a934b8e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:13.895643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46544dee-4c45-4f3a-9846-960a934b8e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:13.896121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46544dee-4c45-4f3a-9846-960a934b8e97 admin admin] PATH_INFO: `/v3/projects/ed1c9db16cb44b24ad835824956bd321/users/1c4fc404f8e14b85b4c052f681ef5601/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:13.918539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46544dee-4c45-4f3a-9846-960a934b8e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1c9db16cb44b24ad835824956bd321, user_id=1c4fc404f8e14b85b4c052f681ef5601, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:13.923299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46544dee-4c45-4f3a-9846-960a934b8e97 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:13.949321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 658/1301] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:13 2022] PUT /identity/v3/projects/ed1c9db16cb44b24ad835824956bd321/users/1c4fc404f8e14b85b4c052f681ef5601/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:13.950665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46544dee-4c45-4f3a-9846-960a934b8e97 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:13.960622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e58f5f99-bf2d-4e25-8595-c14ee82a2999 None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:13.972617 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e58f5f99-bf2d-4e25-8595-c14ee82a2999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:14.066112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:14.081453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46544dee-4c45-4f3a-9846-960a934b8e97 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:14.095998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73314ffd-2b17-43eb-a15d-cbf3b0175f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:14.098305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73314ffd-2b17-43eb-a15d-cbf3b0175f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:14.098584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73314ffd-2b17-43eb-a15d-cbf3b0175f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:14.099000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73314ffd-2b17-43eb-a15d-cbf3b0175f94 admin admin] PATH_INFO: `/v3/projects/07b8a482c7a941e0a7002a9035a0bc6e/users/22bb2d6c0f1e42269c0d45cb5b5ea9d3/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:14.125765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 644/1302] 10.222.0.46 () {58 vars in 1058 bytes} [Mon Oct 24 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:14.127933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f5f99-bf2d-4e25-8595-c14ee82a2999 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:14.153374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f5f99-bf2d-4e25-8595-c14ee82a2999 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:14.155662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73314ffd-2b17-43eb-a15d-cbf3b0175f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b8a482c7a941e0a7002a9035a0bc6e, user_id=22bb2d6c0f1e42269c0d45cb5b5ea9d3, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:14.159979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1a4e8-c009-446c-a288-af369db38d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:14.160672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1a4e8-c009-446c-a288-af369db38d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:14.160989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1a4e8-c009-446c-a288-af369db38d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:14.161265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1a4e8-c009-446c-a288-af369db38d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:14.161984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1a4e8-c009-446c-a288-af369db38d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:14.163727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1a4e8-c009-446c-a288-af369db38d9c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:14.163874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73314ffd-2b17-43eb-a15d-cbf3b0175f94 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:14.182815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 645/1303] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:14.184513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1a4e8-c009-446c-a288-af369db38d9c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:14.196428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 659/1304] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:13 2022] PUT /identity/v3/projects/07b8a482c7a941e0a7002a9035a0bc6e/users/22bb2d6c0f1e42269c0d45cb5b5ea9d3/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:14.197418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73314ffd-2b17-43eb-a15d-cbf3b0175f94 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:14.206274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1a4e8-c009-446c-a288-af369db38d9c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:14.288586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73314ffd-2b17-43eb-a15d-cbf3b0175f94 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:14.302488 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748b1f-d657-4bd6-bf96-e8648f9c7ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:14.303244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748b1f-d657-4bd6-bf96-e8648f9c7ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:14.303498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748b1f-d657-4bd6-bf96-e8648f9c7ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:14.303784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748b1f-d657-4bd6-bf96-e8648f9c7ff8 admin admin] PATH_INFO: `/v3/projects/ed1c9db16cb44b24ad835824956bd321/users/1c4fc404f8e14b85b4c052f681ef5601/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:14.310014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748b1f-d657-4bd6-bf96-e8648f9c7ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1c9db16cb44b24ad835824956bd321, user_id=1c4fc404f8e14b85b4c052f681ef5601, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:14.311216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:14.319285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748b1f-d657-4bd6-bf96-e8648f9c7ff8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:14.345241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8856e-2058-4641-a0e8-a0336836fd80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:14.346409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8856e-2058-4641-a0e8-a0336836fd80 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:14.346990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8856e-2058-4641-a0e8-a0336836fd80 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:14.347502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8856e-2058-4641-a0e8-a0336836fd80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:14.356373 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 660/1305] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:14 2022] PUT /identity/v3/projects/ed1c9db16cb44b24ad835824956bd321/users/1c4fc404f8e14b85b4c052f681ef5601/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:14.357451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748b1f-d657-4bd6-bf96-e8648f9c7ff8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:14.470449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748b1f-d657-4bd6-bf96-e8648f9c7ff8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:14.477244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f6273-20b8-4c7a-a91a-8bacec015a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:14.478231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f6273-20b8-4c7a-a91a-8bacec015a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:14.478871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f6273-20b8-4c7a-a91a-8bacec015a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:14.479344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f6273-20b8-4c7a-a91a-8bacec015a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:14.480473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f6273-20b8-4c7a-a91a-8bacec015a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:14.483445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f6273-20b8-4c7a-a91a-8bacec015a1e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:14.499513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8856e-2058-4641-a0e8-a0336836fd80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:14.503006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8856e-2058-4641-a0e8-a0336836fd80 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:14.503629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 661/1306] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:14.505200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bda35a-7605-4212-81e0-86aab576d4fe None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:14.505539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bda35a-7605-4212-81e0-86aab576d4fe None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:14.505817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bda35a-7605-4212-81e0-86aab576d4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:14.547756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 646/1307] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:14.548806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8856e-2058-4641-a0e8-a0336836fd80 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:14.586411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8856e-2058-4641-a0e8-a0336836fd80 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:14.607300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880dcd2-79be-4f3e-b90e-cfa66aae59b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:14.610744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-34bda35a-7605-4212-81e0-86aab576d4fe None None] MFA Rules not processed for user `1c4fc404f8e14b85b4c052f681ef5601`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:14.612332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880dcd2-79be-4f3e-b90e-cfa66aae59b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:14.612638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880dcd2-79be-4f3e-b90e-cfa66aae59b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:14.612911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880dcd2-79be-4f3e-b90e-cfa66aae59b8 admin admin] PATH_INFO: `/v3/projects/07b8a482c7a941e0a7002a9035a0bc6e/users/22bb2d6c0f1e42269c0d45cb5b5ea9d3/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:14.619318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880dcd2-79be-4f3e-b90e-cfa66aae59b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b8a482c7a941e0a7002a9035a0bc6e, user_id=22bb2d6c0f1e42269c0d45cb5b5ea9d3, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:14.620523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-34bda35a-7605-4212-81e0-86aab576d4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:14.628012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880dcd2-79be-4f3e-b90e-cfa66aae59b8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:14.671725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 647/1308] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:14 2022] PUT /identity/v3/projects/07b8a482c7a941e0a7002a9035a0bc6e/users/22bb2d6c0f1e42269c0d45cb5b5ea9d3/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:14.673841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8097310-f9d6-45d8-9065-295afc32d832 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:14.674130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8097310-f9d6-45d8-9065-295afc32d832 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:14.674393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8097310-f9d6-45d8-9065-295afc32d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:14.789499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a8097310-f9d6-45d8-9065-295afc32d832 None None] MFA Rules not processed for user `22bb2d6c0f1e42269c0d45cb5b5ea9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:14.799001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a8097310-f9d6-45d8-9065-295afc32d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:14.809476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:14.833553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 662/1309] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:14.846600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bda35a-7605-4212-81e0-86aab576d4fe None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:15.001238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bda35a-7605-4212-81e0-86aab576d4fe None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:15.007586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 648/1310] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:15.026966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8097310-f9d6-45d8-9065-295afc32d832 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:15.120469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cab647-7bc5-4403-8bc3-e41bcbf19bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:15.121233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cab647-7bc5-4403-8bc3-e41bcbf19bdd service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:15.121872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cab647-7bc5-4403-8bc3-e41bcbf19bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:15.122154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cab647-7bc5-4403-8bc3-e41bcbf19bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:15.149801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8097310-f9d6-45d8-9065-295afc32d832 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:15.161798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951e85-40d3-4359-9c4c-f879837b3611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:15.162492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951e85-40d3-4359-9c4c-f879837b3611 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:15.162714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951e85-40d3-4359-9c4c-f879837b3611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:15.162988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951e85-40d3-4359-9c4c-f879837b3611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:15.174384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:15.182890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951e85-40d3-4359-9c4c-f879837b3611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:15.185096 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951e85-40d3-4359-9c4c-f879837b3611 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:15.217216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 649/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:42:15.313289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cab647-7bc5-4403-8bc3-e41bcbf19bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:15.319961 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cab647-7bc5-4403-8bc3-e41bcbf19bdd service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:15.363769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 663/1312] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:42:15.416899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951e85-40d3-4359-9c4c-f879837b3611 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:15.426812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951e85-40d3-4359-9c4c-f879837b3611 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:15.446138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb27bd6-8c9b-41df-bb0a-67c4552aa7ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:15.446777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb27bd6-8c9b-41df-bb0a-67c4552aa7ee service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:15.447751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb27bd6-8c9b-41df-bb0a-67c4552aa7ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:15.447751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb27bd6-8c9b-41df-bb0a-67c4552aa7ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:15.516111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cab647-7bc5-4403-8bc3-e41bcbf19bdd service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:15.526071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cab647-7bc5-4403-8bc3-e41bcbf19bdd service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:15.536384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753be1f2-eac2-4dee-a210-cce105c29975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:15.538285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753be1f2-eac2-4dee-a210-cce105c29975 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:15.538722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753be1f2-eac2-4dee-a210-cce105c29975 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:15.539338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753be1f2-eac2-4dee-a210-cce105c29975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:15.609564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb27bd6-8c9b-41df-bb0a-67c4552aa7ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:15.611436 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb27bd6-8c9b-41df-bb0a-67c4552aa7ee service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:15.640464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 650/1313] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:15.690857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753be1f2-eac2-4dee-a210-cce105c29975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:15.699294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753be1f2-eac2-4dee-a210-cce105c29975 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:15.707801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:15.731488 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 664/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:42:15.939062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5dd68-7866-4e4a-96d4-eaf0464dee1e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:15.939387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5dd68-7866-4e4a-96d4-eaf0464dee1e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:15.939651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5dd68-7866-4e4a-96d4-eaf0464dee1e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:15.941023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 651/1315] 10.222.0.46 () {54 vars in 961 bytes} [Mon Oct 24 13:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:42:15.971461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03483ee-8d9c-4b18-8ecd-b1412b48edb7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:15.971695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03483ee-8d9c-4b18-8ecd-b1412b48edb7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:15.971918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03483ee-8d9c-4b18-8ecd-b1412b48edb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:16.023708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e03483ee-8d9c-4b18-8ecd-b1412b48edb7 None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:16.024949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e03483ee-8d9c-4b18-8ecd-b1412b48edb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:16.230193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 665/1316] 10.222.0.46 () {58 vars in 1058 bytes} [Mon Oct 24 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:16.239519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a808a-a949-4914-bcb7-050189f65bf4 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:16.240336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a808a-a949-4914-bcb7-050189f65bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:16.240929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a808a-a949-4914-bcb7-050189f65bf4 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:16.242295 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 652/1317] 10.222.0.46 () {54 vars in 912 bytes} [Mon Oct 24 13:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:42:16.248405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87d3f-3b56-4801-a0ae-05f3dfe44dab None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:16.249417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87d3f-3b56-4801-a0ae-05f3dfe44dab None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:16.249799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87d3f-3b56-4801-a0ae-05f3dfe44dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:16.289827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f0e87d3f-3b56-4801-a0ae-05f3dfe44dab None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:16.292742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f0e87d3f-3b56-4801-a0ae-05f3dfe44dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:16.321428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 666/1318] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:42:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:16.338970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a808a-a949-4914-bcb7-050189f65bf4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:16.359053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a808a-a949-4914-bcb7-050189f65bf4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:16.364347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829aba6-5a71-4d76-bd7c-7559a5288452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:16.365493 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829aba6-5a71-4d76-bd7c-7559a5288452 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:16.365966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829aba6-5a71-4d76-bd7c-7559a5288452 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:16.366388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829aba6-5a71-4d76-bd7c-7559a5288452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:16.386490 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829aba6-5a71-4d76-bd7c-7559a5288452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:16.388341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829aba6-5a71-4d76-bd7c-7559a5288452 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:16.429284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 653/1319] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:16.647566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152dbb5-266e-4767-826a-4ccb3235cb31 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:16.647992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152dbb5-266e-4767-826a-4ccb3235cb31 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:16.648407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152dbb5-266e-4767-826a-4ccb3235cb31 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:16.650289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 667/1320] 10.222.0.46 () {54 vars in 912 bytes} [Mon Oct 24 13:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:42:16.656318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa1e40-cc60-4ce9-adc3-c173309b7c33 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:16.656732 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa1e40-cc60-4ce9-adc3-c173309b7c33 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:16.657105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa1e40-cc60-4ce9-adc3-c173309b7c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:16.712788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-32fa1e40-cc60-4ce9-adc3-c173309b7c33 None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:16.714235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-32fa1e40-cc60-4ce9-adc3-c173309b7c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:16.767453 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 654/1321] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:42:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:16.768612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152dbb5-266e-4767-826a-4ccb3235cb31 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:16.796413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152dbb5-266e-4767-826a-4ccb3235cb31 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:16.801179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1ee88-37fa-43ca-b347-f8c5541906a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:16.801549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1ee88-37fa-43ca-b347-f8c5541906a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:16.801828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1ee88-37fa-43ca-b347-f8c5541906a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:16.802096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1ee88-37fa-43ca-b347-f8c5541906a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:16.820824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1ee88-37fa-43ca-b347-f8c5541906a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:16.823316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1ee88-37fa-43ca-b347-f8c5541906a2 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:16.837519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 668/1322] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:17.018806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa1e40-cc60-4ce9-adc3-c173309b7c33 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:17.185547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa1e40-cc60-4ce9-adc3-c173309b7c33 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:17.203731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:17.204689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:17.206043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:17.207267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] PATH_INFO: `/v3/users/4d8d857b78ca42c6a1080c3fe41fb22f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:17.211406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8d857b78ca42c6a1080c3fe41fb22f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:17.214494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:17.379893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8d857b78ca42c6a1080c3fe41fb22f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:17.381640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8d857b78ca42c6a1080c3fe41fb22f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:17.398152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8d857b78ca42c6a1080c3fe41fb22f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:17.426711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8d857b78ca42c6a1080c3fe41fb22f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:17.427664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8d857b78ca42c6a1080c3fe41fb22f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:17.430845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:17.461684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 655/1323] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:17 2022] DELETE /identity/v3/users/4d8d857b78ca42c6a1080c3fe41fb22f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:17.463369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b1ba-abd2-4a1e-9615-ff84710a5536 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:17.464914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b1ba-abd2-4a1e-9615-ff84710a5536 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:17.465440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b1ba-abd2-4a1e-9615-ff84710a5536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:17.509245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e037b1ba-abd2-4a1e-9615-ff84710a5536 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:17.511472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e037b1ba-abd2-4a1e-9615-ff84710a5536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:17.678391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 669/1324] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:42:17.816166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:17.817835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:18.075823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efaae6-90d5-43e5-a908-078ef3f8bd8c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:18.093906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e506b-c909-46a7-af58-2563fbb41c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:18.094746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e506b-c909-46a7-af58-2563fbb41c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:18.095057 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e506b-c909-46a7-af58-2563fbb41c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:18.095354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e506b-c909-46a7-af58-2563fbb41c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:18.118055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e506b-c909-46a7-af58-2563fbb41c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:18.120216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e506b-c909-46a7-af58-2563fbb41c1c service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:18.160353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 656/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:19.500207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037b1ba-abd2-4a1e-9615-ff84710a5536 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:19.501688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e037b1ba-abd2-4a1e-9615-ff84710a5536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:19.522527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037b1ba-abd2-4a1e-9615-ff84710a5536 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:19.541454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:19.542142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:19.542399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:19.542673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] PATH_INFO: `/v3/projects/3d33b787112841fe92b3d1a253838e7d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:19.544729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d33b787112841fe92b3d1a253838e7d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:19.546961 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:19.660382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d33b787112841fe92b3d1a253838e7d', 'request_id': 'req-417c0ead-fa49-492e-8642-25b64d22cac8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:19.675843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d33b787112841fe92b3d1a253838e7d', 'request_id': 'req-417c0ead-fa49-492e-8642-25b64d22cac8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:19.686545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d33b787112841fe92b3d1a253838e7d', 'request_id': 'req-417c0ead-fa49-492e-8642-25b64d22cac8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:19.705853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:19.730204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] The token cache is being invalidate because project 3d33b787112841fe92b3d1a253838e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:19.730768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:19.733759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-417c0ead-fa49-492e-8642-25b64d22cac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:19.741876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 670/1326] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:19 2022] DELETE /identity/v3/projects/3d33b787112841fe92b3d1a253838e7d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:19.743652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fcb4e-3b1e-4a58-ae8f-b8df53bae3aa None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:19.744173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fcb4e-3b1e-4a58-ae8f-b8df53bae3aa None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:19.744339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fcb4e-3b1e-4a58-ae8f-b8df53bae3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:19.776165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0d1fcb4e-3b1e-4a58-ae8f-b8df53bae3aa None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:19.777929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0d1fcb4e-3b1e-4a58-ae8f-b8df53bae3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:19.885409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 657/1327] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:19.893685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153e4ed-4bf0-4486-9b7c-ccd55b614c73 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:19.894032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153e4ed-4bf0-4486-9b7c-ccd55b614c73 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:19.894266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153e4ed-4bf0-4486-9b7c-ccd55b614c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:19.930336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c153e4ed-4bf0-4486-9b7c-ccd55b614c73 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:19.931623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c153e4ed-4bf0-4486-9b7c-ccd55b614c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:19.956663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 671/1328] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:19.962240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fcb4e-3b1e-4a58-ae8f-b8df53bae3aa None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:19.979697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fcb4e-3b1e-4a58-ae8f-b8df53bae3aa None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:19.996651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3303a-727d-45f4-85b4-f9074a77d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:19.997291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3303a-727d-45f4-85b4-f9074a77d920 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:19.997566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3303a-727d-45f4-85b4-f9074a77d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:19.997837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3303a-727d-45f4-85b4-f9074a77d920 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:19.998901 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3303a-727d-45f4-85b4-f9074a77d920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:19.999242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3303a-727d-45f4-85b4-f9074a77d920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:20.000882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3303a-727d-45f4-85b4-f9074a77d920 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:20.032795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 658/1329] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:20.036723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153e4ed-4bf0-4486-9b7c-ccd55b614c73 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:20.046251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153e4ed-4bf0-4486-9b7c-ccd55b614c73 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:20.064071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7639af-1e04-4313-8fce-6913521f3ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:20.064702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7639af-1e04-4313-8fce-6913521f3ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:20.064959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7639af-1e04-4313-8fce-6913521f3ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:20.065225 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7639af-1e04-4313-8fce-6913521f3ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:20.065874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7639af-1e04-4313-8fce-6913521f3ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:20.067957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7639af-1e04-4313-8fce-6913521f3ad1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:20.138607 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3303a-727d-45f4-85b4-f9074a77d920 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:20.139393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 672/1330] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:20 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:20.150803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3303a-727d-45f4-85b4-f9074a77d920 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:20.337649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eef992-c89e-488c-a492-daed37212a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:20.338313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eef992-c89e-488c-a492-daed37212a93 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:20.338582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eef992-c89e-488c-a492-daed37212a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:20.338867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eef992-c89e-488c-a492-daed37212a93 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:20.339554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eef992-c89e-488c-a492-daed37212a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:20.341581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eef992-c89e-488c-a492-daed37212a93 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:20.394424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 659/1331] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:20 2022] POST /identity/v3/users => generated 303 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:20.396390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7639af-1e04-4313-8fce-6913521f3ad1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:20.414276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7639af-1e04-4313-8fce-6913521f3ad1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:20.444078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e2862-2652-4ec0-8ba5-d2f104a0c14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:20.445278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e2862-2652-4ec0-8ba5-d2f104a0c14b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:20.446757 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e2862-2652-4ec0-8ba5-d2f104a0c14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:20.447218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e2862-2652-4ec0-8ba5-d2f104a0c14b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:20.449078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e2862-2652-4ec0-8ba5-d2f104a0c14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:20.465485 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e2862-2652-4ec0-8ba5-d2f104a0c14b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:20.494936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 673/1332] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:20.497360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eef992-c89e-488c-a492-daed37212a93 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:20.517794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eef992-c89e-488c-a492-daed37212a93 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:20.534621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e218c4-67d8-4811-8e36-764de4e15de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:20.535277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e218c4-67d8-4811-8e36-764de4e15de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:20.535548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e218c4-67d8-4811-8e36-764de4e15de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:20.535816 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e218c4-67d8-4811-8e36-764de4e15de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:20.536465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e218c4-67d8-4811-8e36-764de4e15de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:20.538358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e218c4-67d8-4811-8e36-764de4e15de5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:20.544429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:20.557091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e2862-2652-4ec0-8ba5-d2f104a0c14b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:20.558471 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 660/1333] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:20.570859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e2862-2652-4ec0-8ba5-d2f104a0c14b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:20.576533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3325-4665-431c-98d0-01364abd6e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:20.577430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3325-4665-431c-98d0-01364abd6e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:20.577889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3325-4665-431c-98d0-01364abd6e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:20.578307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3325-4665-431c-98d0-01364abd6e07 admin admin] PATH_INFO: `/v3/projects/5cde51ba9da944a193e0bf9a14ae9f73/users/fc3fde03b7df4aea87f6062d13dbf73c/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:20.595204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3325-4665-431c-98d0-01364abd6e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cde51ba9da944a193e0bf9a14ae9f73, user_id=fc3fde03b7df4aea87f6062d13dbf73c, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:20.598166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3325-4665-431c-98d0-01364abd6e07 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:20.631147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 674/1334] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:20 2022] PUT /identity/v3/projects/5cde51ba9da944a193e0bf9a14ae9f73/users/fc3fde03b7df4aea87f6062d13dbf73c/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:42:20.632977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baed372-ccb9-428c-92cc-f97f29f2b525 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:20.633550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baed372-ccb9-428c-92cc-f97f29f2b525 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:20.633964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baed372-ccb9-428c-92cc-f97f29f2b525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:20.685632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4baed372-ccb9-428c-92cc-f97f29f2b525 None None] MFA Rules not processed for user `fc3fde03b7df4aea87f6062d13dbf73c`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:20.687145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4baed372-ccb9-428c-92cc-f97f29f2b525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:20.793203 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 661/1335] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:20 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:42:20.793799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3325-4665-431c-98d0-01364abd6e07 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:20.919866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3325-4665-431c-98d0-01364abd6e07 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:20.956743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0a90a-1259-4827-9e72-aabbe35a45cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:20.957390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0a90a-1259-4827-9e72-aabbe35a45cb admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:20.960071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0a90a-1259-4827-9e72-aabbe35a45cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:20.960356 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0a90a-1259-4827-9e72-aabbe35a45cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:20.961303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0a90a-1259-4827-9e72-aabbe35a45cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:20.963164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0a90a-1259-4827-9e72-aabbe35a45cb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:21.018763 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 675/1336] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:20 2022] POST /identity/v3/projects => generated 403 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:21.022730 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baed372-ccb9-428c-92cc-f97f29f2b525 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:21.048173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baed372-ccb9-428c-92cc-f97f29f2b525 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:21.195334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f32222-98ce-4a4d-9f60-65285b9a2f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:21.196570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f32222-98ce-4a4d-9f60-65285b9a2f87 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:21.197120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f32222-98ce-4a4d-9f60-65285b9a2f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:21.197402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f32222-98ce-4a4d-9f60-65285b9a2f87 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:21.198177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f32222-98ce-4a4d-9f60-65285b9a2f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:21.200367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f32222-98ce-4a4d-9f60-65285b9a2f87 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:21.239459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 662/1337] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:21 2022] POST /identity/v3/users => generated 308 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:21.241167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0a90a-1259-4827-9e72-aabbe35a45cb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:21.283816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0a90a-1259-4827-9e72-aabbe35a45cb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:21.290974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277eae2-dfb9-4d09-8a22-ac5f8327bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:21.291959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277eae2-dfb9-4d09-8a22-ac5f8327bf03 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:21.292490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277eae2-dfb9-4d09-8a22-ac5f8327bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:21.293102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277eae2-dfb9-4d09-8a22-ac5f8327bf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:21.293915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277eae2-dfb9-4d09-8a22-ac5f8327bf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:21.298535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277eae2-dfb9-4d09-8a22-ac5f8327bf03 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:21.348425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 676/1338] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:21.350287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f32222-98ce-4a4d-9f60-65285b9a2f87 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:21.373777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f32222-98ce-4a4d-9f60-65285b9a2f87 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:21.388443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14542c20-dd90-415b-ba23-20bda13a8377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:21.389514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14542c20-dd90-415b-ba23-20bda13a8377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:21.390003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14542c20-dd90-415b-ba23-20bda13a8377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:21.390330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14542c20-dd90-415b-ba23-20bda13a8377 admin admin] PATH_INFO: `/v3/projects/8daa08cf1dc047ff897907d068bd84c6/users/3794cf92bee94788995e4a42a1cf2f0a/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:21.423239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14542c20-dd90-415b-ba23-20bda13a8377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8daa08cf1dc047ff897907d068bd84c6, user_id=3794cf92bee94788995e4a42a1cf2f0a, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:21.425984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14542c20-dd90-415b-ba23-20bda13a8377 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:21.464000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 663/1339] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:21 2022] PUT /identity/v3/projects/8daa08cf1dc047ff897907d068bd84c6/users/3794cf92bee94788995e4a42a1cf2f0a/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:21.466414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277eae2-dfb9-4d09-8a22-ac5f8327bf03 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:21.487411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277eae2-dfb9-4d09-8a22-ac5f8327bf03 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:21.650217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40ee79-ae42-4dd2-9660-02fdb7bd095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:21.650900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40ee79-ae42-4dd2-9660-02fdb7bd095f admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:21.651156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40ee79-ae42-4dd2-9660-02fdb7bd095f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:21.651756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40ee79-ae42-4dd2-9660-02fdb7bd095f admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:21.652764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40ee79-ae42-4dd2-9660-02fdb7bd095f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:21.655310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40ee79-ae42-4dd2-9660-02fdb7bd095f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:21.684671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:21.693150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 677/1340] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:21.697306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14542c20-dd90-415b-ba23-20bda13a8377 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:21.728580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14542c20-dd90-415b-ba23-20bda13a8377 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:21.739938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ddf00-47ed-4a94-8fda-be9a06fe0ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:21.748411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ddf00-47ed-4a94-8fda-be9a06fe0ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:21.748725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ddf00-47ed-4a94-8fda-be9a06fe0ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:21.748983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ddf00-47ed-4a94-8fda-be9a06fe0ab1 admin admin] PATH_INFO: `/v3/projects/8daa08cf1dc047ff897907d068bd84c6/users/3794cf92bee94788995e4a42a1cf2f0a/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:21.754541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ddf00-47ed-4a94-8fda-be9a06fe0ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8daa08cf1dc047ff897907d068bd84c6, user_id=3794cf92bee94788995e4a42a1cf2f0a, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:21.764342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ddf00-47ed-4a94-8fda-be9a06fe0ab1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:21.795794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 664/1341] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:21 2022] PUT /identity/v3/projects/8daa08cf1dc047ff897907d068bd84c6/users/3794cf92bee94788995e4a42a1cf2f0a/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:21.821164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2ed3-6628-479c-87b6-da057a05bcf2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:21.821681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2ed3-6628-479c-87b6-da057a05bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:21.822366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2ed3-6628-479c-87b6-da057a05bcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:21.902239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-66de2ed3-6628-479c-87b6-da057a05bcf2 None None] MFA Rules not processed for user `3794cf92bee94788995e4a42a1cf2f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:21.915253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-66de2ed3-6628-479c-87b6-da057a05bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:22.122260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 678/1342] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:22.185130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ddf00-47ed-4a94-8fda-be9a06fe0ab1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:22.188380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-468ddf00-47ed-4a94-8fda-be9a06fe0ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:22.336299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:22.362457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ddf00-47ed-4a94-8fda-be9a06fe0ab1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:22.372447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81eea4-b0f0-4699-b9ae-791ef3d58412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:22.373106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81eea4-b0f0-4699-b9ae-791ef3d58412 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:22.373980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81eea4-b0f0-4699-b9ae-791ef3d58412 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:22.374278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81eea4-b0f0-4699-b9ae-791ef3d58412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:22.414842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81eea4-b0f0-4699-b9ae-791ef3d58412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:22.416362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81eea4-b0f0-4699-b9ae-791ef3d58412 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:22.447039 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 665/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:22 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:22.543891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad29671-fcb9-459b-bfc6-9a335a864695 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:22.544111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad29671-fcb9-459b-bfc6-9a335a864695 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:22.544381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad29671-fcb9-459b-bfc6-9a335a864695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:22.634913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5ad29671-fcb9-459b-bfc6-9a335a864695 None None] MFA Rules not processed for user `59706abd14944c648378688abaac199d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:22.637766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5ad29671-fcb9-459b-bfc6-9a335a864695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:22.804680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 679/1344] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:22.816581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccdf91-6d61-4424-9f63-348f34e54b71 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:22.817482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccdf91-6d61-4424-9f63-348f34e54b71 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:22.817966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccdf91-6d61-4424-9f63-348f34e54b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:22.851090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-efccdf91-6d61-4424-9f63-348f34e54b71 None None] MFA Rules not processed for user `59706abd14944c648378688abaac199d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:22.852768 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-efccdf91-6d61-4424-9f63-348f34e54b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:22.870720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 666/1345] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:22.887234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad29671-fcb9-459b-bfc6-9a335a864695 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:22.889023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5ad29671-fcb9-459b-bfc6-9a335a864695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:22.993171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad29671-fcb9-459b-bfc6-9a335a864695 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:23.003732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199bd1c-83d2-4fbb-be80-983b2c2868ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:23.004808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199bd1c-83d2-4fbb-be80-983b2c2868ef service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:23.005228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199bd1c-83d2-4fbb-be80-983b2c2868ef service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:23.005673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199bd1c-83d2-4fbb-be80-983b2c2868ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:23.028767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199bd1c-83d2-4fbb-be80-983b2c2868ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:23.033724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199bd1c-83d2-4fbb-be80-983b2c2868ef service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:23.049884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccdf91-6d61-4424-9f63-348f34e54b71 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:23.053605 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:23.073409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 680/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:42:23.264375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccdf91-6d61-4424-9f63-348f34e54b71 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:23.277752 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:23.279715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:23.280200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:23.280644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] PATH_INFO: `/v3/users/fc3fde03b7df4aea87f6062d13dbf73c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:23.283680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3fde03b7df4aea87f6062d13dbf73c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:23.286110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:23.490219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3fde03b7df4aea87f6062d13dbf73c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:23.490917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3fde03b7df4aea87f6062d13dbf73c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:23.504060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3fde03b7df4aea87f6062d13dbf73c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:23.522141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3fde03b7df4aea87f6062d13dbf73c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:23.523411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3fde03b7df4aea87f6062d13dbf73c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:23.557877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 667/1347] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:23 2022] DELETE /identity/v3/users/fc3fde03b7df4aea87f6062d13dbf73c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:23.559657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e1034-d246-463e-9a5d-7961be84ef8b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:23.559944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e1034-d246-463e-9a5d-7961be84ef8b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:23.560208 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e1034-d246-463e-9a5d-7961be84ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:23.595324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2a3e1034-d246-463e-9a5d-7961be84ef8b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:23.598738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2a3e1034-d246-463e-9a5d-7961be84ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:23.745140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 681/1348] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:23.800304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:23.801927 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:23.955958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4975ae-e5f9-417c-8a89-c67be78a119b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:23.965605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291e7d8-790d-4252-9a49-010b3882f6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:23.966262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e7d8-790d-4252-9a49-010b3882f6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:23.966541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e7d8-790d-4252-9a49-010b3882f6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:23.966812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e7d8-790d-4252-9a49-010b3882f6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:23.986887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291e7d8-790d-4252-9a49-010b3882f6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:23.988381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291e7d8-790d-4252-9a49-010b3882f6d6 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:24.002114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:24.012613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 668/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:24.727153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822b53a-2494-4e85-902c-5f8345f4db87 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:24.727978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822b53a-2494-4e85-902c-5f8345f4db87 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:24.728403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822b53a-2494-4e85-902c-5f8345f4db87 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:24.731073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 682/1350] 10.222.0.46 () {54 vars in 912 bytes} [Mon Oct 24 13:42:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:42:24.740132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f95f8-5145-4b2f-94d5-73bd7d5f654d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:24.740893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f95f8-5145-4b2f-94d5-73bd7d5f654d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:24.741342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f95f8-5145-4b2f-94d5-73bd7d5f654d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:24.857399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bd7f95f8-5145-4b2f-94d5-73bd7d5f654d None None] MFA Rules not processed for user `fe801da792944be2b6342c483bcb88b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:24.858767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bd7f95f8-5145-4b2f-94d5-73bd7d5f654d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:24.879916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 669/1351] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:42:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:24.906062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822b53a-2494-4e85-902c-5f8345f4db87 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:24.912292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b822b53a-2494-4e85-902c-5f8345f4db87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:24.943354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822b53a-2494-4e85-902c-5f8345f4db87 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:24.957026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e63cd-4128-40d0-bf5d-0fb73f0709aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:24.958137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e63cd-4128-40d0-bf5d-0fb73f0709aa service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:24.960853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e63cd-4128-40d0-bf5d-0fb73f0709aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:24.961543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e63cd-4128-40d0-bf5d-0fb73f0709aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:24.990608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e63cd-4128-40d0-bf5d-0fb73f0709aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:25.001498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e63cd-4128-40d0-bf5d-0fb73f0709aa service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:25.038500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 683/1352] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:26.378573 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f95f8-5145-4b2f-94d5-73bd7d5f654d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:26.381196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bd7f95f8-5145-4b2f-94d5-73bd7d5f654d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:26.518732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e63cd-4128-40d0-bf5d-0fb73f0709aa service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:26.523872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-601e63cd-4128-40d0-bf5d-0fb73f0709aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:26.559973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e63cd-4128-40d0-bf5d-0fb73f0709aa service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:26.574542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:26.579327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:26.580538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:26.582150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] PATH_INFO: `/v3/users/e7675c1adc824170b1c42cc955717a59` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:26.591192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7675c1adc824170b1c42cc955717a59)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:26.598905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:42:26.598905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: warnings.warn(msg) Oct 24 13:42:26.598905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: Oct 24 13:42:26.600865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:26.635472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f95f8-5145-4b2f-94d5-73bd7d5f654d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:26.647531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce58c20-461f-4731-8d73-b67439acdf24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:26.648411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce58c20-461f-4731-8d73-b67439acdf24 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:26.649915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce58c20-461f-4731-8d73-b67439acdf24 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:26.650151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce58c20-461f-4731-8d73-b67439acdf24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:26.655213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dce58c20-461f-4731-8d73-b67439acdf24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:26.688908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce58c20-461f-4731-8d73-b67439acdf24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:26.690479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce58c20-461f-4731-8d73-b67439acdf24 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:26.717375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 670/1353] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:26.739830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb430a-d8ba-4a6f-85d2-730350cbbc09 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:26.740138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb430a-d8ba-4a6f-85d2-730350cbbc09 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:26.741114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb430a-d8ba-4a6f-85d2-730350cbbc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:26.794792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7675c1adc824170b1c42cc955717a59'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:26.796392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-96bb430a-d8ba-4a6f-85d2-730350cbbc09 None None] MFA Rules not processed for user `59706abd14944c648378688abaac199d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:26.797860 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7675c1adc824170b1c42cc955717a59'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:26.801224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96bb430a-d8ba-4a6f-85d2-730350cbbc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:26.824389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7675c1adc824170b1c42cc955717a59'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:26.876583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7675c1adc824170b1c42cc955717a59'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:26.878419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-12bd366d-d8a1-45f4-b41c-3324257b4156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7675c1adc824170b1c42cc955717a59'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:26.914631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 684/1354] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:26 2022] DELETE /identity/v3/users/e7675c1adc824170b1c42cc955717a59 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:26.922600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059cd9c-692a-48f5-bf27-f6715ac5f2c0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:26.923723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059cd9c-692a-48f5-bf27-f6715ac5f2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:26.924169 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059cd9c-692a-48f5-bf27-f6715ac5f2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:26.969775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0059cd9c-692a-48f5-bf27-f6715ac5f2c0 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:26.971744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0059cd9c-692a-48f5-bf27-f6715ac5f2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:26.979325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 671/1355] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:27.138327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:27.170192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 685/1356] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:27.203500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb430a-d8ba-4a6f-85d2-730350cbbc09 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:27.205121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96bb430a-d8ba-4a6f-85d2-730350cbbc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:27.237914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb430a-d8ba-4a6f-85d2-730350cbbc09 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:27.428269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434fc84-e9a7-43fd-9a3f-108ec62ea8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:27.429294 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434fc84-e9a7-43fd-9a3f-108ec62ea8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:27.431184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434fc84-e9a7-43fd-9a3f-108ec62ea8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:27.431589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434fc84-e9a7-43fd-9a3f-108ec62ea8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:27.455050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434fc84-e9a7-43fd-9a3f-108ec62ea8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:27.458812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434fc84-e9a7-43fd-9a3f-108ec62ea8c2 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:27.489405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 672/1357] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:27.638543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059cd9c-692a-48f5-bf27-f6715ac5f2c0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:27.641973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0059cd9c-692a-48f5-bf27-f6715ac5f2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:27.668065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059cd9c-692a-48f5-bf27-f6715ac5f2c0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:27.691770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:27.692456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:27.692789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:27.693349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] PATH_INFO: `/v3/projects/5cde51ba9da944a193e0bf9a14ae9f73` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:27.694749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cde51ba9da944a193e0bf9a14ae9f73)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:27.703496 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:27.838281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cde51ba9da944a193e0bf9a14ae9f73', 'request_id': 'req-9a0d8352-bb63-424a-93fe-c326c16eb75e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:27.850469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cde51ba9da944a193e0bf9a14ae9f73', 'request_id': 'req-9a0d8352-bb63-424a-93fe-c326c16eb75e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:27.859148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cde51ba9da944a193e0bf9a14ae9f73', 'request_id': 'req-9a0d8352-bb63-424a-93fe-c326c16eb75e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:27.883985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] The token cache is being invalidate because project 5cde51ba9da944a193e0bf9a14ae9f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:27.884731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:27.885662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9a0d8352-bb63-424a-93fe-c326c16eb75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:27.889281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 686/1358] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:27 2022] DELETE /identity/v3/projects/5cde51ba9da944a193e0bf9a14ae9f73 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:27.895289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434fc84-e9a7-43fd-9a3f-108ec62ea8c2 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:27.926536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434fc84-e9a7-43fd-9a3f-108ec62ea8c2 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:27.973549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:28.076463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:28.077576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:28.077976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:28.078577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] PATH_INFO: `/v3/users/3794cf92bee94788995e4a42a1cf2f0a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:28.088895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3794cf92bee94788995e4a42a1cf2f0a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:28.091994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:28.231331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3794cf92bee94788995e4a42a1cf2f0a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:28.234195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3794cf92bee94788995e4a42a1cf2f0a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:28.254215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3794cf92bee94788995e4a42a1cf2f0a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:28.291505 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3794cf92bee94788995e4a42a1cf2f0a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:28.292234 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee904fa2-c639-4886-b809-cb98369d47e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3794cf92bee94788995e4a42a1cf2f0a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:28.321497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 673/1359] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:27 2022] DELETE /identity/v3/users/3794cf92bee94788995e4a42a1cf2f0a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:29.308368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca93cf-8140-4a48-b7c1-76527f92c9fe None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:29.308950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca93cf-8140-4a48-b7c1-76527f92c9fe None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:29.309046 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca93cf-8140-4a48-b7c1-76527f92c9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:29.327769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced026fb-6f94-47dc-bff9-3adc7e0c94de None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:29.328364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced026fb-6f94-47dc-bff9-3adc7e0c94de None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:29.328364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced026fb-6f94-47dc-bff9-3adc7e0c94de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:29.394286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-10ca93cf-8140-4a48-b7c1-76527f92c9fe None None] MFA Rules not processed for user `79a2780405ee4b77a63166819c3da789`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:29.397543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-10ca93cf-8140-4a48-b7c1-76527f92c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:29.414669 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ced026fb-6f94-47dc-bff9-3adc7e0c94de None None] MFA Rules not processed for user `6414c4b3a3ca4d4bab67712790abff00`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:29.419010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ced026fb-6f94-47dc-bff9-3adc7e0c94de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:29.672755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 687/1360] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:29.677165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca93cf-8140-4a48-b7c1-76527f92c9fe None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:29.687004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-10ca93cf-8140-4a48-b7c1-76527f92c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:29.754108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 674/1361] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:29.759127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced026fb-6f94-47dc-bff9-3adc7e0c94de None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:29.761564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ced026fb-6f94-47dc-bff9-3adc7e0c94de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:29.839702 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:29.928010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca93cf-8140-4a48-b7c1-76527f92c9fe None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:29.943568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:29.948104 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:29.948498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:29.948779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] PATH_INFO: `/v3/projects/8daa08cf1dc047ff897907d068bd84c6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:29.950135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8daa08cf1dc047ff897907d068bd84c6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:29.952623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:29.962503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced026fb-6f94-47dc-bff9-3adc7e0c94de None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:29.975440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a581a6-395d-4094-bc5f-9ebfa7a5bc9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:29.976083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a581a6-395d-4094-bc5f-9ebfa7a5bc9d service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:29.976360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a581a6-395d-4094-bc5f-9ebfa7a5bc9d service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:29.976629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a581a6-395d-4094-bc5f-9ebfa7a5bc9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:30.007232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:30.018809 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a581a6-395d-4094-bc5f-9ebfa7a5bc9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:30.023778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a581a6-395d-4094-bc5f-9ebfa7a5bc9d service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:30.077509 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 675/1362] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:30.078411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a581a6-395d-4094-bc5f-9ebfa7a5bc9d service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:30.086855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96a581a6-395d-4094-bc5f-9ebfa7a5bc9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:30.099671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8daa08cf1dc047ff897907d068bd84c6', 'request_id': 'req-28634591-b33b-4bca-ab0c-9bac48c176bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.106427 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8daa08cf1dc047ff897907d068bd84c6', 'request_id': 'req-28634591-b33b-4bca-ab0c-9bac48c176bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.134438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8daa08cf1dc047ff897907d068bd84c6', 'request_id': 'req-28634591-b33b-4bca-ab0c-9bac48c176bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.166345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a581a6-395d-4094-bc5f-9ebfa7a5bc9d service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:30.172434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] The token cache is being invalidate because project 8daa08cf1dc047ff897907d068bd84c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:30.172872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.174997 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28634591-b33b-4bca-ab0c-9bac48c176bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.177629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 688/1363] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:29 2022] DELETE /identity/v3/projects/8daa08cf1dc047ff897907d068bd84c6 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:30.183293 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e4c8b-79ae-4629-9127-ec50aa3c66a6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:30.183955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e4c8b-79ae-4629-9127-ec50aa3c66a6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:30.184444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e4c8b-79ae-4629-9127-ec50aa3c66a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:30.215112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-202e4c8b-79ae-4629-9127-ec50aa3c66a6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:30.216853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-202e4c8b-79ae-4629-9127-ec50aa3c66a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:30.446970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 689/1364] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:30.454699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6a99f-9bd6-4b83-a2b3-c6535738eb6f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:30.456131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6a99f-9bd6-4b83-a2b3-c6535738eb6f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:30.457568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6a99f-9bd6-4b83-a2b3-c6535738eb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:30.494517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb26958-b3a7-4c6a-aef2-d1524e2a5b67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:30.496649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb26958-b3a7-4c6a-aef2-d1524e2a5b67 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:30.497030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb26958-b3a7-4c6a-aef2-d1524e2a5b67 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:30.498761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb26958-b3a7-4c6a-aef2-d1524e2a5b67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:30.503830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2bb26958-b3a7-4c6a-aef2-d1524e2a5b67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:30.519259 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-24d6a99f-9bd6-4b83-a2b3-c6535738eb6f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:30.523389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-24d6a99f-9bd6-4b83-a2b3-c6535738eb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:30.550078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 690/1365] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:30.551712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6a99f-9bd6-4b83-a2b3-c6535738eb6f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:30.575464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6a99f-9bd6-4b83-a2b3-c6535738eb6f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:30.589109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:30.590688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:30.592175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:30.592796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:30.594564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:30.594668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:30.597597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:30.635653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 691/1366] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:30.636822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:30.643074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:30.672321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb26958-b3a7-4c6a-aef2-d1524e2a5b67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:30.685354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e48435-54c8-4054-b989-9363a1b2d48d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:30.691620 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb26958-b3a7-4c6a-aef2-d1524e2a5b67 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:30.722046 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:30.722873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:30.723582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:30.727191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] PATH_INFO: `/v3/projects/83eaafb421bd4854a6a38b9b3b072c25` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:30.730245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83eaafb421bd4854a6a38b9b3b072c25)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:30.736749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 676/1367] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:30.738989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb26958-b3a7-4c6a-aef2-d1524e2a5b67 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:30.741359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:30.777686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb26958-b3a7-4c6a-aef2-d1524e2a5b67 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:30.798792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ef5f9-ef61-4baa-a209-eb2f1ee68851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:30.800446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ef5f9-ef61-4baa-a209-eb2f1ee68851 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:30.800786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ef5f9-ef61-4baa-a209-eb2f1ee68851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:30.801063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ef5f9-ef61-4baa-a209-eb2f1ee68851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:30.802660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ef5f9-ef61-4baa-a209-eb2f1ee68851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:30.808159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ef5f9-ef61-4baa-a209-eb2f1ee68851 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:30.895609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83eaafb421bd4854a6a38b9b3b072c25', 'request_id': 'req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.912998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 677/1368] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:30 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:30.918228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ef5f9-ef61-4baa-a209-eb2f1ee68851 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:30.921981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83eaafb421bd4854a6a38b9b3b072c25', 'request_id': 'req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.938768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83eaafb421bd4854a6a38b9b3b072c25', 'request_id': 'req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.983299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] The token cache is being invalidate because project 83eaafb421bd4854a6a38b9b3b072c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:30.983692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.987372 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:30.998673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 692/1369] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:30 2022] DELETE /identity/v3/projects/83eaafb421bd4854a6a38b9b3b072c25 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:31.004326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:31.008509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:31.043775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:31.052758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:31.184124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9d18a-7a26-4ebe-929b-b22a8e1962d2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:31.295350 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ef5f9-ef61-4baa-a209-eb2f1ee68851 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:31.315165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8cdb-69e4-4df1-814c-c1e4e5b77fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:31.317664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8cdb-69e4-4df1-814c-c1e4e5b77fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:31.318351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8cdb-69e4-4df1-814c-c1e4e5b77fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:31.318351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8cdb-69e4-4df1-814c-c1e4e5b77fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:31.338524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff8cdb-69e4-4df1-814c-c1e4e5b77fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:31.340834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff8cdb-69e4-4df1-814c-c1e4e5b77fe6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:31.387994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:31.387994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:31.388248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:31.388378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] PATH_INFO: `/v3/users/22bb2d6c0f1e42269c0d45cb5b5ea9d3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:31.393064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bb2d6c0f1e42269c0d45cb5b5ea9d3)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:31.408955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:31.418350 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 678/1370] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:30 2022] POST /identity/v3/users => generated 283 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:31.423906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8cdb-69e4-4df1-814c-c1e4e5b77fe6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:31.427232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b3ff8cdb-69e4-4df1-814c-c1e4e5b77fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:31.460341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8cdb-69e4-4df1-814c-c1e4e5b77fe6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:31.475225 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287619e5-86ed-4d46-a439-bf30765353d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:31.478763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287619e5-86ed-4d46-a439-bf30765353d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:31.479464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287619e5-86ed-4d46-a439-bf30765353d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:31.479755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287619e5-86ed-4d46-a439-bf30765353d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:31.480463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287619e5-86ed-4d46-a439-bf30765353d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:31.487808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287619e5-86ed-4d46-a439-bf30765353d3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:31.533310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 679/1371] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:31.536682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0793d4-1eed-437e-9d90-8c3d029ce44a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:31.538144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0793d4-1eed-437e-9d90-8c3d029ce44a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:31.540500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0793d4-1eed-437e-9d90-8c3d029ce44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:31.572163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bb2d6c0f1e42269c0d45cb5b5ea9d3'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:31.573209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bb2d6c0f1e42269c0d45cb5b5ea9d3'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:31.591413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bb2d6c0f1e42269c0d45cb5b5ea9d3'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:31.627964 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bb2d6c0f1e42269c0d45cb5b5ea9d3'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:31.633054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bb2d6c0f1e42269c0d45cb5b5ea9d3'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:31.664938 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 693/1372] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:30 2022] DELETE /identity/v3/users/22bb2d6c0f1e42269c0d45cb5b5ea9d3 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:31.669450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:31.677931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:31.732981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bf0793d4-1eed-437e-9d90-8c3d029ce44a None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:31.734400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bf0793d4-1eed-437e-9d90-8c3d029ce44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:31.785570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:31.854409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e29a3-31a6-406e-8591-b87242747804 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:31.864990 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaff2f-b9dd-434f-8f5d-0e18bf965ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:31.867143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaff2f-b9dd-434f-8f5d-0e18bf965ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:31.868193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaff2f-b9dd-434f-8f5d-0e18bf965ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:31.868689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaff2f-b9dd-434f-8f5d-0e18bf965ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:31.869318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaff2f-b9dd-434f-8f5d-0e18bf965ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:31.873611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaff2f-b9dd-434f-8f5d-0e18bf965ddf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:31.915901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 694/1373] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:31.923706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaff2f-b9dd-434f-8f5d-0e18bf965ddf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:31.930729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 680/1374] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:42:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:31.940253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaff2f-b9dd-434f-8f5d-0e18bf965ddf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:31.946736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310a303-193d-4236-b88c-300a5ea0206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:31.947352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310a303-193d-4236-b88c-300a5ea0206a admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:31.947444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310a303-193d-4236-b88c-300a5ea0206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:31.947684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310a303-193d-4236-b88c-300a5ea0206a admin admin] PATH_INFO: `/v3/projects/662a3004bfe84997b4a0cfe1dc1df5cd/users/1808d6c7630949378c45a1fc7241aadf/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:31.967421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310a303-193d-4236-b88c-300a5ea0206a admin admin] RBAC: Authorizing `identity:create_grant(project_id=662a3004bfe84997b4a0cfe1dc1df5cd, user_id=1808d6c7630949378c45a1fc7241aadf, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:31.971184 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310a303-193d-4236-b88c-300a5ea0206a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:32.029102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 695/1375] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:31 2022] PUT /identity/v3/projects/662a3004bfe84997b4a0cfe1dc1df5cd/users/1808d6c7630949378c45a1fc7241aadf/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:32.030071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1446d47-d312-4319-9f5b-921ff06bc9c4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:32.030828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1446d47-d312-4319-9f5b-921ff06bc9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:32.031291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1446d47-d312-4319-9f5b-921ff06bc9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:32.090168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e1446d47-d312-4319-9f5b-921ff06bc9c4 None None] MFA Rules not processed for user `1808d6c7630949378c45a1fc7241aadf`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:32.091634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e1446d47-d312-4319-9f5b-921ff06bc9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:32.226999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 681/1376] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:32.230875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310a303-193d-4236-b88c-300a5ea0206a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:32.261139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1446d47-d312-4319-9f5b-921ff06bc9c4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:32.262951 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e1446d47-d312-4319-9f5b-921ff06bc9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:32.294296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:32.422538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310a303-193d-4236-b88c-300a5ea0206a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:32.448374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce037544-c321-45e2-a5e4-1624c0a3a3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:32.450305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce037544-c321-45e2-a5e4-1624c0a3a3bd admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:32.450703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce037544-c321-45e2-a5e4-1624c0a3a3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:32.452368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce037544-c321-45e2-a5e4-1624c0a3a3bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:32.453136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce037544-c321-45e2-a5e4-1624c0a3a3bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:32.455525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce037544-c321-45e2-a5e4-1624c0a3a3bd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:32.526217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 696/1377] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:32 2022] POST /identity/v3/projects => generated 365 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:32.530992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce037544-c321-45e2-a5e4-1624c0a3a3bd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:32.541844 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1446d47-d312-4319-9f5b-921ff06bc9c4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:32.758689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400640a7-afb7-434a-95c5-33570753be38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:32.763368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400640a7-afb7-434a-95c5-33570753be38 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:32.763807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400640a7-afb7-434a-95c5-33570753be38 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:32.764196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400640a7-afb7-434a-95c5-33570753be38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:32.765319 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce037544-c321-45e2-a5e4-1624c0a3a3bd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:32.804645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6efa19-0550-45a5-8c5d-d722c64b844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:32.808951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6efa19-0550-45a5-8c5d-d722c64b844c admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:32.812465 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6efa19-0550-45a5-8c5d-d722c64b844c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:32.814067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6efa19-0550-45a5-8c5d-d722c64b844c admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:32.818473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6efa19-0550-45a5-8c5d-d722c64b844c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:32.835290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6efa19-0550-45a5-8c5d-d722c64b844c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:32.913186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400640a7-afb7-434a-95c5-33570753be38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:32.916765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400640a7-afb7-434a-95c5-33570753be38 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:32.933673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 697/1378] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:32 2022] POST /identity/v3/users => generated 289 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:32.934845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6efa19-0550-45a5-8c5d-d722c64b844c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:32.961911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 682/1379] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:42:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:42:32.997011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6efa19-0550-45a5-8c5d-d722c64b844c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:33.012487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834bdd-0597-4bca-99ed-1324208e2fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:33.014807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834bdd-0597-4bca-99ed-1324208e2fef admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:33.015442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834bdd-0597-4bca-99ed-1324208e2fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:33.019337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834bdd-0597-4bca-99ed-1324208e2fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:33.021655 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f834bdd-0597-4bca-99ed-1324208e2fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:33.023852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f834bdd-0597-4bca-99ed-1324208e2fef admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:33.067352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400640a7-afb7-434a-95c5-33570753be38 service swift] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:33.070464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 698/1380] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:33.123435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400640a7-afb7-434a-95c5-33570753be38 service swift] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:33.150050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9eff7-fb62-4258-93d7-04ead4e63799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:33.156407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9eff7-fb62-4258-93d7-04ead4e63799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:33.157361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9eff7-fb62-4258-93d7-04ead4e63799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:33.157640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9eff7-fb62-4258-93d7-04ead4e63799 admin admin] PATH_INFO: `/v3/projects/7ce0b505c71c4639bd6661f7cd60ecda/users/e96252f87f7b44268b66d4fd1c499dcb/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:33.231103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9eff7-fb62-4258-93d7-04ead4e63799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce0b505c71c4639bd6661f7cd60ecda, user_id=e96252f87f7b44268b66d4fd1c499dcb, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:33.252337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9eff7-fb62-4258-93d7-04ead4e63799 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:33.313061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 683/1381] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:33 2022] PUT /identity/v3/projects/7ce0b505c71c4639bd6661f7cd60ecda/users/e96252f87f7b44268b66d4fd1c499dcb/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:42:33.314299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834bdd-0597-4bca-99ed-1324208e2fef admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:33.333817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834bdd-0597-4bca-99ed-1324208e2fef admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:33.349486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:33.528931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca86d4-ea9a-464b-a6cd-fcbd13622694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:33.529934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca86d4-ea9a-464b-a6cd-fcbd13622694 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:33.530388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca86d4-ea9a-464b-a6cd-fcbd13622694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:33.530763 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca86d4-ea9a-464b-a6cd-fcbd13622694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:33.531920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca86d4-ea9a-464b-a6cd-fcbd13622694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:33.533606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca86d4-ea9a-464b-a6cd-fcbd13622694 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:33.562004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 699/1382] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:33.565716 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9eff7-fb62-4258-93d7-04ead4e63799 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:33.586870 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9eff7-fb62-4258-93d7-04ead4e63799 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:33.631795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daf592-b7be-4f69-a584-5f585da770e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:33.634083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daf592-b7be-4f69-a584-5f585da770e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:33.634553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daf592-b7be-4f69-a584-5f585da770e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:33.634947 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daf592-b7be-4f69-a584-5f585da770e3 admin admin] PATH_INFO: `/v3/projects/7ce0b505c71c4639bd6661f7cd60ecda/users/e96252f87f7b44268b66d4fd1c499dcb/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:33.652488 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9daf592-b7be-4f69-a584-5f585da770e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce0b505c71c4639bd6661f7cd60ecda, user_id=e96252f87f7b44268b66d4fd1c499dcb, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:33.663660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9daf592-b7be-4f69-a584-5f585da770e3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:33.665336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:33.712503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 684/1383] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:33 2022] PUT /identity/v3/projects/7ce0b505c71c4639bd6661f7cd60ecda/users/e96252f87f7b44268b66d4fd1c499dcb/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:33.716103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4732-56f9-4a8d-8027-73e41f5d17bf None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:33.717223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4732-56f9-4a8d-8027-73e41f5d17bf None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:33.717527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4732-56f9-4a8d-8027-73e41f5d17bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:33.786021 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-64bc4732-56f9-4a8d-8027-73e41f5d17bf None None] MFA Rules not processed for user `e96252f87f7b44268b66d4fd1c499dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:33.794307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-64bc4732-56f9-4a8d-8027-73e41f5d17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:34.070344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 700/1384] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:42:34.085782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daf592-b7be-4f69-a584-5f585da770e3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:34.087565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a9daf592-b7be-4f69-a584-5f585da770e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:34.375404 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daf592-b7be-4f69-a584-5f585da770e3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:34.382560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719f86b-bc56-4f9b-9b14-6478e4a50602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:34.383408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f86b-bc56-4f9b-9b14-6478e4a50602 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:34.383757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f86b-bc56-4f9b-9b14-6478e4a50602 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:34.384211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f86b-bc56-4f9b-9b14-6478e4a50602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:34.419430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719f86b-bc56-4f9b-9b14-6478e4a50602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:34.435231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719f86b-bc56-4f9b-9b14-6478e4a50602 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:34.485353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 685/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:35.061341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc4732-56f9-4a8d-8027-73e41f5d17bf None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:35.063587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-64bc4732-56f9-4a8d-8027-73e41f5d17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:35.232811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc4732-56f9-4a8d-8027-73e41f5d17bf None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:35.248019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:35.252202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:35.252380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:35.253788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] PATH_INFO: `/v3/projects/07b8a482c7a941e0a7002a9035a0bc6e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:35.258172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b8a482c7a941e0a7002a9035a0bc6e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:35.261175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:35.340010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:35.412349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b8a482c7a941e0a7002a9035a0bc6e', 'request_id': 'req-b3fdebb7-4a27-4946-b671-1d02c1d68de6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:35.433413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b8a482c7a941e0a7002a9035a0bc6e', 'request_id': 'req-b3fdebb7-4a27-4946-b671-1d02c1d68de6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:35.460178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b8a482c7a941e0a7002a9035a0bc6e', 'request_id': 'req-b3fdebb7-4a27-4946-b671-1d02c1d68de6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:35.497719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] The token cache is being invalidate because project 07b8a482c7a941e0a7002a9035a0bc6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:35.498060 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:35.503075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:35.506515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 701/1386] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:35 2022] DELETE /identity/v3/projects/07b8a482c7a941e0a7002a9035a0bc6e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:35.514878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3730-4bc6-49b2-ae38-16a2eeccbb01 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:35.516353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3730-4bc6-49b2-ae38-16a2eeccbb01 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:35.516788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3730-4bc6-49b2-ae38-16a2eeccbb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:35.592731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f41c3730-4bc6-49b2-ae38-16a2eeccbb01 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:35.593992 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f41c3730-4bc6-49b2-ae38-16a2eeccbb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:35.711371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:35.717148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:35.868737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 686/1387] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:35.870424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe0db-fe4c-486c-a5e1-fa1e1f2f7fc4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:35.871593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe0db-fe4c-486c-a5e1-fa1e1f2f7fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:35.871967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe0db-fe4c-486c-a5e1-fa1e1f2f7fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:35.912736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e3dfe0db-fe4c-486c-a5e1-fa1e1f2f7fc4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:35.913766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e3dfe0db-fe4c-486c-a5e1-fa1e1f2f7fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:35.964999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 687/1388] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:35.967289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516a77b-11ca-4284-9ced-df7eef3e9e2f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:35.967974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516a77b-11ca-4284-9ced-df7eef3e9e2f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:35.968502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516a77b-11ca-4284-9ced-df7eef3e9e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:36.019893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdebb7-4a27-4946-b671-1d02c1d68de6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:36.030857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e516a77b-11ca-4284-9ced-df7eef3e9e2f None None] MFA Rules not processed for user `447498c7fe844b5d8cc616d71c3ff7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:36.033429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e516a77b-11ca-4284-9ced-df7eef3e9e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:36.055164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:36.056025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:36.056160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:36.056377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] PATH_INFO: `/v3/users/1808d6c7630949378c45a1fc7241aadf` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:36.061771 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1808d6c7630949378c45a1fc7241aadf)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:36.066743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:36.215854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 688/1389] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:36.219449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516a77b-11ca-4284-9ced-df7eef3e9e2f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:36.241388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1808d6c7630949378c45a1fc7241aadf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:36.242052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1808d6c7630949378c45a1fc7241aadf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:36.258339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516a77b-11ca-4284-9ced-df7eef3e9e2f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:36.272865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:36.273744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:36.274165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:36.274562 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:36.275394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:36.276118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:36.277945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:36.309125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1808d6c7630949378c45a1fc7241aadf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:36.309599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 689/1390] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:36.310759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:36.316953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:36.339947 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:36.360280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1808d6c7630949378c45a1fc7241aadf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:36.361523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-96964f1b-6f45-42b0-a9bc-6eb56ed23922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1808d6c7630949378c45a1fc7241aadf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:36.405271 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 702/1391] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:35 2022] DELETE /identity/v3/users/1808d6c7630949378c45a1fc7241aadf => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:36.407056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870debaa-3600-4c92-af62-e5eb9adc1cba None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:36.408429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870debaa-3600-4c92-af62-e5eb9adc1cba None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:36.408930 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870debaa-3600-4c92-af62-e5eb9adc1cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:36.507385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-870debaa-3600-4c92-af62-e5eb9adc1cba None None] MFA Rules not processed for user `52d8410aace14d04848ada4f2bff174a`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:36.515331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e701db-3e14-4657-bd86-b1ccdc105045 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:36.516806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-870debaa-3600-4c92-af62-e5eb9adc1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:36.656412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:36.705677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a927152-4e91-4eca-8a4e-6901750b8c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:36.706372 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a927152-4e91-4eca-8a4e-6901750b8c82 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:36.706683 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a927152-4e91-4eca-8a4e-6901750b8c82 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:36.707024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a927152-4e91-4eca-8a4e-6901750b8c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:36.715917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7a927152-4e91-4eca-8a4e-6901750b8c82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:36.837734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 703/1392] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:36.837734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870debaa-3600-4c92-af62-e5eb9adc1cba None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:36.847250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-870debaa-3600-4c92-af62-e5eb9adc1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:37.088865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870debaa-3600-4c92-af62-e5eb9adc1cba None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:37.114657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f65266-9caf-43a6-9e5a-d4ef6d0e492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:37.115665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65266-9caf-43a6-9e5a-d4ef6d0e492d admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:37.116101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65266-9caf-43a6-9e5a-d4ef6d0e492d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:37.116533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65266-9caf-43a6-9e5a-d4ef6d0e492d admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:37.119281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f65266-9caf-43a6-9e5a-d4ef6d0e492d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:37.127944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a927152-4e91-4eca-8a4e-6901750b8c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:37.131602 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a927152-4e91-4eca-8a4e-6901750b8c82 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:37.146022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f65266-9caf-43a6-9e5a-d4ef6d0e492d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:37.173133 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 690/1393] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 861 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:37.179101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52059ce7-fe73-4b03-911e-79fcfe4a3978 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:37.179551 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52059ce7-fe73-4b03-911e-79fcfe4a3978 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:37.182537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52059ce7-fe73-4b03-911e-79fcfe4a3978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:37.237342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-52059ce7-fe73-4b03-911e-79fcfe4a3978 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:37.240468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-52059ce7-fe73-4b03-911e-79fcfe4a3978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:37.248753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 704/1394] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:36 2022] POST /identity/v3/projects => generated 393 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:37.250307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9783e-a257-43b1-a6d1-a45cd8c9813a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:37.250599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9783e-a257-43b1-a6d1-a45cd8c9813a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:37.252917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9783e-a257-43b1-a6d1-a45cd8c9813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:37.312388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-83e9783e-a257-43b1-a6d1-a45cd8c9813a None None] MFA Rules not processed for user `52d8410aace14d04848ada4f2bff174a`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:37.313844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-83e9783e-a257-43b1-a6d1-a45cd8c9813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:37.443787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:37.494726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 705/1395] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:37.494726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9783e-a257-43b1-a6d1-a45cd8c9813a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:37.532175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 691/1396] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:37.532175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52059ce7-fe73-4b03-911e-79fcfe4a3978 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:37.540491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-52059ce7-fe73-4b03-911e-79fcfe4a3978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:37.723617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9783e-a257-43b1-a6d1-a45cd8c9813a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:37.749538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08145-b49e-4184-97ab-82b1524dd13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:37.750240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08145-b49e-4184-97ab-82b1524dd13f admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:37.750570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08145-b49e-4184-97ab-82b1524dd13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:37.750743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08145-b49e-4184-97ab-82b1524dd13f admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:37.751395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a08145-b49e-4184-97ab-82b1524dd13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:37.753328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a08145-b49e-4184-97ab-82b1524dd13f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:37.773259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52059ce7-fe73-4b03-911e-79fcfe4a3978 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:37.787753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:37.788987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc1bcf-9e5a-4142-9732-7891cebb034c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:37.790183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1bcf-9e5a-4142-9732-7891cebb034c service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:37.790183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1bcf-9e5a-4142-9732-7891cebb034c service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:37.790358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1bcf-9e5a-4142-9732-7891cebb034c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:37.821153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 706/1397] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:37 2022] POST /identity/v3/users => generated 297 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:37.826666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc1bcf-9e5a-4142-9732-7891cebb034c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:37.827227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3489cd-7b7a-4fc8-a059-e347f8593cdb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:37.827631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3489cd-7b7a-4fc8-a059-e347f8593cdb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:37.827915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3489cd-7b7a-4fc8-a059-e347f8593cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:37.829400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc1bcf-9e5a-4142-9732-7891cebb034c service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:37.868986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 692/1398] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:37.888167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc1bcf-9e5a-4142-9732-7891cebb034c service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:37.902097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1e3489cd-7b7a-4fc8-a059-e347f8593cdb None None] MFA Rules not processed for user `fe801da792944be2b6342c483bcb88b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:37.903396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1e3489cd-7b7a-4fc8-a059-e347f8593cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:37.956500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc1bcf-9e5a-4142-9732-7891cebb034c service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:37.993416 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85904-4456-46a5-b74c-3dddfeedc9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:37.994146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85904-4456-46a5-b74c-3dddfeedc9ab admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:37.994422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85904-4456-46a5-b74c-3dddfeedc9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:37.994705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85904-4456-46a5-b74c-3dddfeedc9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:37.995418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e85904-4456-46a5-b74c-3dddfeedc9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:38.022450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e85904-4456-46a5-b74c-3dddfeedc9ab admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:38.090150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 693/1399] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:38.097739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85904-4456-46a5-b74c-3dddfeedc9ab admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:38.152874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85904-4456-46a5-b74c-3dddfeedc9ab admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:38.165527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 707/1400] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Oct 24 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:38.180406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73d670-1f06-44b8-a6ac-c45b1d24ec69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:38.182143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73d670-1f06-44b8-a6ac-c45b1d24ec69 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:38.182687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73d670-1f06-44b8-a6ac-c45b1d24ec69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:38.183183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73d670-1f06-44b8-a6ac-c45b1d24ec69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:38.184367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73d670-1f06-44b8-a6ac-c45b1d24ec69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:38.186275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73d670-1f06-44b8-a6ac-c45b1d24ec69 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:38.240992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3489cd-7b7a-4fc8-a059-e347f8593cdb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:38.249470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 694/1401] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:38.259651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3489cd-7b7a-4fc8-a059-e347f8593cdb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:38.283557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e430625-b2b8-4a89-88e5-9b57f8316690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:38.284274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e430625-b2b8-4a89-88e5-9b57f8316690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:38.284555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e430625-b2b8-4a89-88e5-9b57f8316690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:38.284829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e430625-b2b8-4a89-88e5-9b57f8316690 admin admin] PATH_INFO: `/v3/projects/8260592c54bb4ea589ac03a4a59f97a2/users/f31b05c015bb4b81b979c31156621b36/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:38.344207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e430625-b2b8-4a89-88e5-9b57f8316690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8260592c54bb4ea589ac03a4a59f97a2, user_id=f31b05c015bb4b81b979c31156621b36, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:38.358996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e430625-b2b8-4a89-88e5-9b57f8316690 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:38.387044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 708/1402] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:38 2022] PUT /identity/v3/projects/8260592c54bb4ea589ac03a4a59f97a2/users/f31b05c015bb4b81b979c31156621b36/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:38.401060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d86560-8887-46df-8604-def4a57241d8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:38.401398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d86560-8887-46df-8604-def4a57241d8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:38.401775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d86560-8887-46df-8604-def4a57241d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:38.411065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e430625-b2b8-4a89-88e5-9b57f8316690 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:38.414714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0e430625-b2b8-4a89-88e5-9b57f8316690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:38.560253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-33d86560-8887-46df-8604-def4a57241d8 None None] MFA Rules not processed for user `f31b05c015bb4b81b979c31156621b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:38.561605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-33d86560-8887-46df-8604-def4a57241d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:38.655635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e430625-b2b8-4a89-88e5-9b57f8316690 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:38.677434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b161f37-76d2-4f1a-9505-843420d4c1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:38.678087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b161f37-76d2-4f1a-9505-843420d4c1fd service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:38.678360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b161f37-76d2-4f1a-9505-843420d4c1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:38.678624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b161f37-76d2-4f1a-9505-843420d4c1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:38.820891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 695/1403] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:38.823311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d86560-8887-46df-8604-def4a57241d8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:38.852476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d86560-8887-46df-8604-def4a57241d8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:38.868390 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657387c4-8271-4e2f-977f-cfd82d5a2420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:38.869087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657387c4-8271-4e2f-977f-cfd82d5a2420 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:38.869367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657387c4-8271-4e2f-977f-cfd82d5a2420 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:38.869642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657387c4-8271-4e2f-977f-cfd82d5a2420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:38.903778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b161f37-76d2-4f1a-9505-843420d4c1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:38.905409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b161f37-76d2-4f1a-9505-843420d4c1fd service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:38.909606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657387c4-8271-4e2f-977f-cfd82d5a2420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:38.921258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657387c4-8271-4e2f-977f-cfd82d5a2420 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:38.950224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 696/1404] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:38.952706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657387c4-8271-4e2f-977f-cfd82d5a2420 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:38.962635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 709/1405] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:42:38.967492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657387c4-8271-4e2f-977f-cfd82d5a2420 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:38.981553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c84e0-9341-4739-a361-2bfc8a3ffa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:38.982559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c84e0-9341-4739-a361-2bfc8a3ffa58 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:38.984589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c84e0-9341-4739-a361-2bfc8a3ffa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:38.999011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c84e0-9341-4739-a361-2bfc8a3ffa58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:39.004528 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c84e0-9341-4739-a361-2bfc8a3ffa58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:39.007673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c84e0-9341-4739-a361-2bfc8a3ffa58 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:39.068254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:39.094321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b161f37-76d2-4f1a-9505-843420d4c1fd service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:39.094744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 697/1406] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:38 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:39.110658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b161f37-76d2-4f1a-9505-843420d4c1fd service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:39.179994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:39.256861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543962-a070-4cfb-af66-7afc04e23893 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:39.257483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543962-a070-4cfb-af66-7afc04e23893 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:39.257766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543962-a070-4cfb-af66-7afc04e23893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:39.300070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3c543962-a070-4cfb-af66-7afc04e23893 None None] MFA Rules not processed for user `6414c4b3a3ca4d4bab67712790abff00`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:39.301332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3c543962-a070-4cfb-af66-7afc04e23893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:39.330242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65b8ea-e638-4fda-91f3-ce9947944b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:39.334494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65b8ea-e638-4fda-91f3-ce9947944b20 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:39.334813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65b8ea-e638-4fda-91f3-ce9947944b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:39.335118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65b8ea-e638-4fda-91f3-ce9947944b20 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:39.346985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65b8ea-e638-4fda-91f3-ce9947944b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:39.353587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65b8ea-e638-4fda-91f3-ce9947944b20 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:39.393250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 710/1407] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:39 2022] POST /identity/v3/users => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:42:39.397654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65b8ea-e638-4fda-91f3-ce9947944b20 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:39.458662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65b8ea-e638-4fda-91f3-ce9947944b20 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:39.463566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 698/1408] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:42:39.482365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882056d-9908-49fb-8cb0-6fe1cf403307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:39.491805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882056d-9908-49fb-8cb0-6fe1cf403307 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:39.495390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882056d-9908-49fb-8cb0-6fe1cf403307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:39.495962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882056d-9908-49fb-8cb0-6fe1cf403307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:39.498869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882056d-9908-49fb-8cb0-6fe1cf403307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:39.504720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882056d-9908-49fb-8cb0-6fe1cf403307 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:39.547581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 711/1409] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:39.553016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543962-a070-4cfb-af66-7afc04e23893 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:39.572465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543962-a070-4cfb-af66-7afc04e23893 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:39.602041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f162-2655-43b7-9b22-71e469f69f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:39.602750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f162-2655-43b7-9b22-71e469f69f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:39.603055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f162-2655-43b7-9b22-71e469f69f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:39.603327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f162-2655-43b7-9b22-71e469f69f54 admin admin] PATH_INFO: `/v3/projects/310c86f7dd3f4a0699b65b7ef8190d6b/users/7987dcd35c904f9793be2edc162fbadc/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:39.684535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8f162-2655-43b7-9b22-71e469f69f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310c86f7dd3f4a0699b65b7ef8190d6b, user_id=7987dcd35c904f9793be2edc162fbadc, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:39.687631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8f162-2655-43b7-9b22-71e469f69f54 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:39.728326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 699/1410] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:39 2022] PUT /identity/v3/projects/310c86f7dd3f4a0699b65b7ef8190d6b/users/7987dcd35c904f9793be2edc162fbadc/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:39.732467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882056d-9908-49fb-8cb0-6fe1cf403307 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:39.760065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882056d-9908-49fb-8cb0-6fe1cf403307 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:39.969133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90706b-66c7-4b02-adaf-41c4f4158a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:39.971775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90706b-66c7-4b02-adaf-41c4f4158a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:39.973153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90706b-66c7-4b02-adaf-41c4f4158a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:39.973840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90706b-66c7-4b02-adaf-41c4f4158a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:39.976153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90706b-66c7-4b02-adaf-41c4f4158a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:39.980353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90706b-66c7-4b02-adaf-41c4f4158a3c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:40.018090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 712/1411] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:40.022834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f162-2655-43b7-9b22-71e469f69f54 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:40.041514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f162-2655-43b7-9b22-71e469f69f54 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:40.058257 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f0bb3-e99d-49e3-8d0b-f15534ba254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:40.060899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f0bb3-e99d-49e3-8d0b-f15534ba254e admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:40.060899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f0bb3-e99d-49e3-8d0b-f15534ba254e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:40.060899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f0bb3-e99d-49e3-8d0b-f15534ba254e admin admin] PATH_INFO: `/v3/projects/310c86f7dd3f4a0699b65b7ef8190d6b/users/7987dcd35c904f9793be2edc162fbadc/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:40.080363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f0bb3-e99d-49e3-8d0b-f15534ba254e admin admin] RBAC: Authorizing `identity:create_grant(project_id=310c86f7dd3f4a0699b65b7ef8190d6b, user_id=7987dcd35c904f9793be2edc162fbadc, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:40.098123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f0bb3-e99d-49e3-8d0b-f15534ba254e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:40.135608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 700/1412] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:40 2022] PUT /identity/v3/projects/310c86f7dd3f4a0699b65b7ef8190d6b/users/7987dcd35c904f9793be2edc162fbadc/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:40.137900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6278-46fb-4bfa-960c-ba56b831c481 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:40.138566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6278-46fb-4bfa-960c-ba56b831c481 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:40.139868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6278-46fb-4bfa-960c-ba56b831c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:40.221444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a4aa6278-46fb-4bfa-960c-ba56b831c481 None None] MFA Rules not processed for user `7987dcd35c904f9793be2edc162fbadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:40.224965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a4aa6278-46fb-4bfa-960c-ba56b831c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:40.402587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 713/1413] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:42:40.411593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f0bb3-e99d-49e3-8d0b-f15534ba254e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:40.414378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f50f0bb3-e99d-49e3-8d0b-f15534ba254e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:40.564137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f0bb3-e99d-49e3-8d0b-f15534ba254e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:40.578672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e5e39-34bc-4842-9e1f-cc2b7b76ae47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:40.580127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e5e39-34bc-4842-9e1f-cc2b7b76ae47 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:40.580561 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e5e39-34bc-4842-9e1f-cc2b7b76ae47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:40.580983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e5e39-34bc-4842-9e1f-cc2b7b76ae47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:40.608560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e5e39-34bc-4842-9e1f-cc2b7b76ae47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:40.611247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e5e39-34bc-4842-9e1f-cc2b7b76ae47 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:40.643557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 701/1414] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:40.776619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa6278-46fb-4bfa-960c-ba56b831c481 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:40.778964 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a4aa6278-46fb-4bfa-960c-ba56b831c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:40.799571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa6278-46fb-4bfa-960c-ba56b831c481 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:40.812674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d9bef-085f-4276-8bfc-6a93e6793b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:40.813562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9bef-085f-4276-8bfc-6a93e6793b5e service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:40.814569 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9bef-085f-4276-8bfc-6a93e6793b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:40.815773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9bef-085f-4276-8bfc-6a93e6793b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:40.895356 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:41.057235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d9bef-085f-4276-8bfc-6a93e6793b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:41.058787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d9bef-085f-4276-8bfc-6a93e6793b5e service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:41.110201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 714/1415] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:41.242482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41b35f-d7c1-4b22-accf-f5378ec98a3e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:41.242826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41b35f-d7c1-4b22-accf-f5378ec98a3e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:41.243213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41b35f-d7c1-4b22-accf-f5378ec98a3e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:41.245077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 702/1416] 10.222.0.46 () {54 vars in 912 bytes} [Mon Oct 24 13:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:42:41.262482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba15e8-e1c7-44c5-b67c-fac2eb3fd0e7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:41.263275 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba15e8-e1c7-44c5-b67c-fac2eb3fd0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:41.263275 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba15e8-e1c7-44c5-b67c-fac2eb3fd0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:41.329787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a8ba15e8-e1c7-44c5-b67c-fac2eb3fd0e7 None None] MFA Rules not processed for user `fe801da792944be2b6342c483bcb88b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:41.339144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a8ba15e8-e1c7-44c5-b67c-fac2eb3fd0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:41.621390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 715/1417] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:42:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:41.823827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41b35f-d7c1-4b22-accf-f5378ec98a3e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:41.849946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41b35f-d7c1-4b22-accf-f5378ec98a3e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:41.867410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4072b-2d8a-4f46-8fa3-3d16f8734141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:41.868119 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4072b-2d8a-4f46-8fa3-3d16f8734141 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:41.868566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4072b-2d8a-4f46-8fa3-3d16f8734141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:41.868996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4072b-2d8a-4f46-8fa3-3d16f8734141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:41.904317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4072b-2d8a-4f46-8fa3-3d16f8734141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:41.910955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4072b-2d8a-4f46-8fa3-3d16f8734141 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:41.941512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 703/1418] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:42:42.496451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928ca8-1d45-4663-9790-dc4a555c9d66 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:42.496888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928ca8-1d45-4663-9790-dc4a555c9d66 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:42.496981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928ca8-1d45-4663-9790-dc4a555c9d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:42.553674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-16928ca8-1d45-4663-9790-dc4a555c9d66 None None] MFA Rules not processed for user `79a2780405ee4b77a63166819c3da789`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:42.557462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-16928ca8-1d45-4663-9790-dc4a555c9d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:42.723539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4072b-2d8a-4f46-8fa3-3d16f8734141 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:42.725066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4aa4072b-2d8a-4f46-8fa3-3d16f8734141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:42.768759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 716/1419] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:42.865689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:42.877202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4072b-2d8a-4f46-8fa3-3d16f8734141 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:42.895454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:42.896449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:42.896956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:42.897428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] PATH_INFO: `/v3/projects/662a3004bfe84997b4a0cfe1dc1df5cd` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:42.902215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=662a3004bfe84997b4a0cfe1dc1df5cd)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:42.903389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:42:42.903389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: warnings.warn(msg) Oct 24 13:42:42.903389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: Oct 24 13:42:42.909957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:43.293954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662a3004bfe84997b4a0cfe1dc1df5cd', 'request_id': 'req-b43e0a09-c50b-44e2-97ac-bdbecee848bc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:43.358715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662a3004bfe84997b4a0cfe1dc1df5cd', 'request_id': 'req-b43e0a09-c50b-44e2-97ac-bdbecee848bc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:43.398262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662a3004bfe84997b4a0cfe1dc1df5cd', 'request_id': 'req-b43e0a09-c50b-44e2-97ac-bdbecee848bc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:43.450029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] The token cache is being invalidate because project 662a3004bfe84997b4a0cfe1dc1df5cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:43.450449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:43.452337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b43e0a09-c50b-44e2-97ac-bdbecee848bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:43.454314 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 704/1420] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:42 2022] DELETE /identity/v3/projects/662a3004bfe84997b4a0cfe1dc1df5cd => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:42:43.462362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928ca8-1d45-4663-9790-dc4a555c9d66 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:43.484568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928ca8-1d45-4663-9790-dc4a555c9d66 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:43.708277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:43.709200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:43.709480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:43.709755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] PATH_INFO: `/v3/users/e96252f87f7b44268b66d4fd1c499dcb` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:43.713931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96252f87f7b44268b66d4fd1c499dcb)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:43.721734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:43.791085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:43.945548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96252f87f7b44268b66d4fd1c499dcb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:43.947083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96252f87f7b44268b66d4fd1c499dcb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:43.978546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96252f87f7b44268b66d4fd1c499dcb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:44.018428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96252f87f7b44268b66d4fd1c499dcb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:44.021439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-decaa396-4ecc-404a-bafe-4d1689b6f20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96252f87f7b44268b66d4fd1c499dcb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:44.056206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 717/1421] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:43 2022] DELETE /identity/v3/users/e96252f87f7b44268b66d4fd1c499dcb => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:46.743471 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ea901-3cdb-4dd7-98dc-d91822e54e11 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:46.760925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ea901-3cdb-4dd7-98dc-d91822e54e11 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:46.760925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ea901-3cdb-4dd7-98dc-d91822e54e11 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:46.760925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 705/1422] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:42:47.373897 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225df43-a34f-48c5-a450-dd259ba31489 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:47.375162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225df43-a34f-48c5-a450-dd259ba31489 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:47.375594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225df43-a34f-48c5-a450-dd259ba31489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:47.509193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d225df43-a34f-48c5-a450-dd259ba31489 None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:47.510449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d225df43-a34f-48c5-a450-dd259ba31489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:47.785508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 718/1423] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:42:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:47.942871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ea901-3cdb-4dd7-98dc-d91822e54e11 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:47.948363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-db6ea901-3cdb-4dd7-98dc-d91822e54e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:48.085645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225df43-a34f-48c5-a450-dd259ba31489 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:48.087959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d225df43-a34f-48c5-a450-dd259ba31489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:48.108447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225df43-a34f-48c5-a450-dd259ba31489 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:48.120843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1acb2-dbf0-4500-9fb6-250199308c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:48.121712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1acb2-dbf0-4500-9fb6-250199308c40 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:48.122216 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1acb2-dbf0-4500-9fb6-250199308c40 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:48.122652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1acb2-dbf0-4500-9fb6-250199308c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:48.148357 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1acb2-dbf0-4500-9fb6-250199308c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:48.152262 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1acb2-dbf0-4500-9fb6-250199308c40 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:48.167125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 719/1424] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:48.188447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ea901-3cdb-4dd7-98dc-d91822e54e11 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:48.198444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:48.199750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:48.201672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:48.201926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] PATH_INFO: `/v3/users/f31b05c015bb4b81b979c31156621b36` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:48.206040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31b05c015bb4b81b979c31156621b36)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:48.208819 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:48.369724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31b05c015bb4b81b979c31156621b36'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:48.371746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31b05c015bb4b81b979c31156621b36'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:48.399313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31b05c015bb4b81b979c31156621b36'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:48.413871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31b05c015bb4b81b979c31156621b36'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:48.414790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31b05c015bb4b81b979c31156621b36'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:48.442247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 706/1425] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:47 2022] DELETE /identity/v3/users/f31b05c015bb4b81b979c31156621b36 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:48.449544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be31723-5278-4e4f-a640-633c8e12d3b8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:48.450034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be31723-5278-4e4f-a640-633c8e12d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:48.450306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be31723-5278-4e4f-a640-633c8e12d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:48.500066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7be31723-5278-4e4f-a640-633c8e12d3b8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:48.502949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7be31723-5278-4e4f-a640-633c8e12d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:48.658992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 720/1426] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:48.715495 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:48.718226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:48.730464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be31723-5278-4e4f-a640-633c8e12d3b8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:48.734307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7be31723-5278-4e4f-a640-633c8e12d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:48.797606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:48.804804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be31723-5278-4e4f-a640-633c8e12d3b8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:48.820268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:48.823929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:48.831062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:48.832136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] PATH_INFO: `/v3/projects/7ce0b505c71c4639bd6661f7cd60ecda` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:48.834058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce0b505c71c4639bd6661f7cd60ecda)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:48.837227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:48.872209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:48.906386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20990-4621-44aa-9400-2d8e09105705 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:48.910427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2b829-0f1e-484b-b912-cf74aee8b995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:48.912097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2b829-0f1e-484b-b912-cf74aee8b995 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:48.913193 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2b829-0f1e-484b-b912-cf74aee8b995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:48.914783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2b829-0f1e-484b-b912-cf74aee8b995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:48.926662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2b829-0f1e-484b-b912-cf74aee8b995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:48.928661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2b829-0f1e-484b-b912-cf74aee8b995 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:48.955586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 707/1427] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:48.963037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce0b505c71c4639bd6661f7cd60ecda', 'request_id': 'req-f2e4435a-0ac5-404a-83c0-e3a4c656189a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:48.976644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce0b505c71c4639bd6661f7cd60ecda', 'request_id': 'req-f2e4435a-0ac5-404a-83c0-e3a4c656189a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:48.985443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce0b505c71c4639bd6661f7cd60ecda', 'request_id': 'req-f2e4435a-0ac5-404a-83c0-e3a4c656189a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:49.006039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] The token cache is being invalidate because project 7ce0b505c71c4639bd6661f7cd60ecda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:49.006447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:49.007312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f2e4435a-0ac5-404a-83c0-e3a4c656189a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:49.010012 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 721/1428] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:48 2022] DELETE /identity/v3/projects/7ce0b505c71c4639bd6661f7cd60ecda => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:42:49.015172 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75411e-efbc-48eb-b29e-1af50ef9baba None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:49.015449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75411e-efbc-48eb-b29e-1af50ef9baba None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:49.016089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75411e-efbc-48eb-b29e-1af50ef9baba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:49.054428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4d75411e-efbc-48eb-b29e-1af50ef9baba None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:49.055715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4d75411e-efbc-48eb-b29e-1af50ef9baba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:49.213323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 708/1429] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:42:49.222578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a628f04-b776-495c-a125-d432b4b62e93 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:49.223422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a628f04-b776-495c-a125-d432b4b62e93 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:49.223971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a628f04-b776-495c-a125-d432b4b62e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:49.266069 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1a628f04-b776-495c-a125-d432b4b62e93 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:49.267744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1a628f04-b776-495c-a125-d432b4b62e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:49.286029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 722/1430] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:42:49.287143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75411e-efbc-48eb-b29e-1af50ef9baba None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:49.306864 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75411e-efbc-48eb-b29e-1af50ef9baba None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:49.333701 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49919d01-32c2-4785-bab9-25c6f0b972a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:49.334256 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49919d01-32c2-4785-bab9-25c6f0b972a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:49.334560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49919d01-32c2-4785-bab9-25c6f0b972a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:49.334855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49919d01-32c2-4785-bab9-25c6f0b972a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:49.339573 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49919d01-32c2-4785-bab9-25c6f0b972a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:49.343158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49919d01-32c2-4785-bab9-25c6f0b972a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:49.361331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49919d01-32c2-4785-bab9-25c6f0b972a1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:49.408998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 709/1431] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:49.410152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a628f04-b776-495c-a125-d432b4b62e93 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:49.425696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a628f04-b776-495c-a125-d432b4b62e93 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:49.442451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7901eee-d732-4622-93c6-64d8bf9378ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:49.443134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7901eee-d732-4622-93c6-64d8bf9378ae admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:49.443391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7901eee-d732-4622-93c6-64d8bf9378ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:49.443654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7901eee-d732-4622-93c6-64d8bf9378ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:49.444283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7901eee-d732-4622-93c6-64d8bf9378ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:49.446200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7901eee-d732-4622-93c6-64d8bf9378ae admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:49.514591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49919d01-32c2-4785-bab9-25c6f0b972a1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:49.515529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 723/1432] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:49 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:49.526757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49919d01-32c2-4785-bab9-25c6f0b972a1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:49.685429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ef49a-ccb1-4e83-aa41-fbaba514d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:49.686056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ef49a-ccb1-4e83-aa41-fbaba514d9db admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:49.686402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ef49a-ccb1-4e83-aa41-fbaba514d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:49.686678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ef49a-ccb1-4e83-aa41-fbaba514d9db admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:49.687409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ef49a-ccb1-4e83-aa41-fbaba514d9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:49.691627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ef49a-ccb1-4e83-aa41-fbaba514d9db admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:49.740690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 710/1433] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:49 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:42:49.746180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7901eee-d732-4622-93c6-64d8bf9378ae admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:49.766703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7901eee-d732-4622-93c6-64d8bf9378ae admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:49.806946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6301ef8-09b0-45ea-8fdf-03082b4927b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:49.807920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6301ef8-09b0-45ea-8fdf-03082b4927b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:49.809576 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6301ef8-09b0-45ea-8fdf-03082b4927b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:49.809850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6301ef8-09b0-45ea-8fdf-03082b4927b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:49.815830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6301ef8-09b0-45ea-8fdf-03082b4927b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:49.820615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6301ef8-09b0-45ea-8fdf-03082b4927b3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:49.856196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ef49a-ccb1-4e83-aa41-fbaba514d9db admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:49.857112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 724/1434] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:49.868724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ef49a-ccb1-4e83-aa41-fbaba514d9db admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:49.874065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cdec6-43bf-43ef-aafe-fc5568659656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:49.874909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cdec6-43bf-43ef-aafe-fc5568659656 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:49.875437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cdec6-43bf-43ef-aafe-fc5568659656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:49.875853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cdec6-43bf-43ef-aafe-fc5568659656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:49.876694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cdec6-43bf-43ef-aafe-fc5568659656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:49.878706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cdec6-43bf-43ef-aafe-fc5568659656 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:49.909178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6301ef8-09b0-45ea-8fdf-03082b4927b3 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:49.917637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 711/1435] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:49.926001 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6301ef8-09b0-45ea-8fdf-03082b4927b3 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:49.946349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e67ad-98da-4c5a-bea3-eca2c8939db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:49.947082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e67ad-98da-4c5a-bea3-eca2c8939db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:49.947351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e67ad-98da-4c5a-bea3-eca2c8939db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:49.948250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e67ad-98da-4c5a-bea3-eca2c8939db1 admin admin] PATH_INFO: `/v3/projects/151a2ca0db7e46deb3bd074a6a71911f/users/25d3316977244c358ca2e02f72706ee4/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:49.988539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e67ad-98da-4c5a-bea3-eca2c8939db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=151a2ca0db7e46deb3bd074a6a71911f, user_id=25d3316977244c358ca2e02f72706ee4, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:49.992909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e67ad-98da-4c5a-bea3-eca2c8939db1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:50.036252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 725/1436] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:49 2022] PUT /identity/v3/projects/151a2ca0db7e46deb3bd074a6a71911f/users/25d3316977244c358ca2e02f72706ee4/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:42:50.036917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfea54c-f0ea-4b9b-8129-2da15bc3bf48 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:50.037546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfea54c-f0ea-4b9b-8129-2da15bc3bf48 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:50.037820 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfea54c-f0ea-4b9b-8129-2da15bc3bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:50.083061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6dfea54c-f0ea-4b9b-8129-2da15bc3bf48 None None] MFA Rules not processed for user `25d3316977244c358ca2e02f72706ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:50.085860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6dfea54c-f0ea-4b9b-8129-2da15bc3bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:50.091487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:50.214875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f5c5e-a10f-4030-87e3-9a5a742ca780 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:50.215344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f5c5e-a10f-4030-87e3-9a5a742ca780 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:50.215772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f5c5e-a10f-4030-87e3-9a5a742ca780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:50.279470 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7e6f5c5e-a10f-4030-87e3-9a5a742ca780 None None] MFA Rules not processed for user `447498c7fe844b5d8cc616d71c3ff7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:50.282872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7e6f5c5e-a10f-4030-87e3-9a5a742ca780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:50.319364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 712/1437] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:50.323801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfea54c-f0ea-4b9b-8129-2da15bc3bf48 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:50.444520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 726/1438] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:50.516833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfea54c-f0ea-4b9b-8129-2da15bc3bf48 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:50.539583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72ab06-31a3-4898-8b8c-b6a44d63b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:50.540299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72ab06-31a3-4898-8b8c-b6a44d63b0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:50.540602 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72ab06-31a3-4898-8b8c-b6a44d63b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:50.541075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72ab06-31a3-4898-8b8c-b6a44d63b0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:50.541732 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72ab06-31a3-4898-8b8c-b6a44d63b0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:50.543711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72ab06-31a3-4898-8b8c-b6a44d63b0c9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:50.599994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 713/1439] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:50 2022] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:42:50.600996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f5c5e-a10f-4030-87e3-9a5a742ca780 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:50.613437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f5c5e-a10f-4030-87e3-9a5a742ca780 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:50.700737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:50.754622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2eeb-1ea3-41e8-bf5f-144c95f40c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:50.755516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2eeb-1ea3-41e8-bf5f-144c95f40c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:50.755918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2eeb-1ea3-41e8-bf5f-144c95f40c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:50.756412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2eeb-1ea3-41e8-bf5f-144c95f40c93 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:50.757181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a2eeb-1ea3-41e8-bf5f-144c95f40c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:50.759298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a2eeb-1ea3-41e8-bf5f-144c95f40c93 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:50.803100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 727/1440] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:50 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:50.806735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72ab06-31a3-4898-8b8c-b6a44d63b0c9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:50.820924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72ab06-31a3-4898-8b8c-b6a44d63b0c9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:50.834758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe310a-fa72-4253-872d-5f2c62c234e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:50.835762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe310a-fa72-4253-872d-5f2c62c234e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:50.836472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe310a-fa72-4253-872d-5f2c62c234e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:50.837492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe310a-fa72-4253-872d-5f2c62c234e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:50.839612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe310a-fa72-4253-872d-5f2c62c234e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:50.842000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe310a-fa72-4253-872d-5f2c62c234e0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:50.865753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 714/1441] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:50.869738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2eeb-1ea3-41e8-bf5f-144c95f40c93 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:50.886894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2eeb-1ea3-41e8-bf5f-144c95f40c93 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:50.900245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0e1ab-7f87-40a6-bc8b-78a61cf84192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:50.901886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e1ab-7f87-40a6-bc8b-78a61cf84192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:50.902486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e1ab-7f87-40a6-bc8b-78a61cf84192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:50.903706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e1ab-7f87-40a6-bc8b-78a61cf84192 admin admin] PATH_INFO: `/v3/projects/94c7ccaade4d46929b67490a94b1fd0c/users/608d636d316f4d1385f4a992858afde4/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:50.966876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0e1ab-7f87-40a6-bc8b-78a61cf84192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c7ccaade4d46929b67490a94b1fd0c, user_id=608d636d316f4d1385f4a992858afde4, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:50.970254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0e1ab-7f87-40a6-bc8b-78a61cf84192 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:51.003042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 728/1442] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:50 2022] PUT /identity/v3/projects/94c7ccaade4d46929b67490a94b1fd0c/users/608d636d316f4d1385f4a992858afde4/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:51.005840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe310a-fa72-4253-872d-5f2c62c234e0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:51.019598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe310a-fa72-4253-872d-5f2c62c234e0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:51.164171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe90d8d-4237-445b-b76b-338f4098fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:51.165691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90d8d-4237-445b-b76b-338f4098fa5d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:51.166389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90d8d-4237-445b-b76b-338f4098fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:51.166799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90d8d-4237-445b-b76b-338f4098fa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:51.167629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe90d8d-4237-445b-b76b-338f4098fa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:51.170536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe90d8d-4237-445b-b76b-338f4098fa5d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:51.183819 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 715/1443] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:51.187787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0e1ab-7f87-40a6-bc8b-78a61cf84192 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:51.198301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0e1ab-7f87-40a6-bc8b-78a61cf84192 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:51.213453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72c0a0-9d38-4f0d-80ca-292ec47adb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:51.214148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72c0a0-9d38-4f0d-80ca-292ec47adb93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:51.214426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72c0a0-9d38-4f0d-80ca-292ec47adb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:51.214693 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72c0a0-9d38-4f0d-80ca-292ec47adb93 admin admin] PATH_INFO: `/v3/projects/94c7ccaade4d46929b67490a94b1fd0c/users/608d636d316f4d1385f4a992858afde4/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:51.221860 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72c0a0-9d38-4f0d-80ca-292ec47adb93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c7ccaade4d46929b67490a94b1fd0c, user_id=608d636d316f4d1385f4a992858afde4, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:51.226486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72c0a0-9d38-4f0d-80ca-292ec47adb93 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:51.252510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 729/1444] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:51 2022] PUT /identity/v3/projects/94c7ccaade4d46929b67490a94b1fd0c/users/608d636d316f4d1385f4a992858afde4/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:51.253695 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa7b9-4705-472c-994d-9ce67ceea7c9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:51.254245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa7b9-4705-472c-994d-9ce67ceea7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:51.254670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa7b9-4705-472c-994d-9ce67ceea7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:51.304311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a39fa7b9-4705-472c-994d-9ce67ceea7c9 None None] MFA Rules not processed for user `608d636d316f4d1385f4a992858afde4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:51.305550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a39fa7b9-4705-472c-994d-9ce67ceea7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:51.315038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:51.462297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 716/1445] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:51.476418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72c0a0-9d38-4f0d-80ca-292ec47adb93 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:51.478203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7b72c0a0-9d38-4f0d-80ca-292ec47adb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:51.633945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72c0a0-9d38-4f0d-80ca-292ec47adb93 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:51.645018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda487-4e26-4f62-97ad-8ff580d16ddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:51.646189 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda487-4e26-4f62-97ad-8ff580d16ddf service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:51.646676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda487-4e26-4f62-97ad-8ff580d16ddf service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:51.647155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda487-4e26-4f62-97ad-8ff580d16ddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:51.753005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adda487-4e26-4f62-97ad-8ff580d16ddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:51.756312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adda487-4e26-4f62-97ad-8ff580d16ddf service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:51.801426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 730/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:51.858245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fa7b9-4705-472c-994d-9ce67ceea7c9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:51.859720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a39fa7b9-4705-472c-994d-9ce67ceea7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:52.057262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fa7b9-4705-472c-994d-9ce67ceea7c9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:52.076387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:52.079023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:52.084108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:52.084606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] PATH_INFO: `/v3/projects/8260592c54bb4ea589ac03a4a59f97a2` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:52.087851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8260592c54bb4ea589ac03a4a59f97a2)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:52.091002 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:52.251858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8260592c54bb4ea589ac03a4a59f97a2', 'request_id': 'req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.256825 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8260592c54bb4ea589ac03a4a59f97a2', 'request_id': 'req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.264553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8260592c54bb4ea589ac03a4a59f97a2', 'request_id': 'req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.292697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] The token cache is being invalidate because project 8260592c54bb4ea589ac03a4a59f97a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:52.293589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.296272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.298422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 717/1447] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:51 2022] DELETE /identity/v3/projects/8260592c54bb4ea589ac03a4a59f97a2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:52.302228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda487-4e26-4f62-97ad-8ff580d16ddf service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:52.318810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda487-4e26-4f62-97ad-8ff580d16ddf service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:52.425998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:52.453720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:52.455932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:52.456374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:52.456796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] PATH_INFO: `/v3/users/7987dcd35c904f9793be2edc162fbadc` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:52.460113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7987dcd35c904f9793be2edc162fbadc)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:52.462713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:52.566954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7987dcd35c904f9793be2edc162fbadc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.567627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7987dcd35c904f9793be2edc162fbadc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.576680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7987dcd35c904f9793be2edc162fbadc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.600394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7987dcd35c904f9793be2edc162fbadc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.603937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1503e04e-e6c1-49b9-92bc-8815ba5e6e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7987dcd35c904f9793be2edc162fbadc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:52.642082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 731/1448] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:52 2022] DELETE /identity/v3/users/7987dcd35c904f9793be2edc162fbadc => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:42:53.256466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:53.263978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:53.303393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9b652-dcbe-4a2a-a027-7e7d726e1f70 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:53.304043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9b652-dcbe-4a2a-a027-7e7d726e1f70 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:53.304503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9b652-dcbe-4a2a-a027-7e7d726e1f70 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:53.310449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 732/1449] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:42:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:42:53.311913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6466b5-6db2-4ad7-b7a4-a2f1949d3857 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:53.357434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9b713-5691-4b12-8d6c-485e3f769985 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:53.359430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9b713-5691-4b12-8d6c-485e3f769985 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:53.360077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9b713-5691-4b12-8d6c-485e3f769985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:53.416533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:53.417703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a1a9b713-5691-4b12-8d6c-485e3f769985 None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:53.419215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a1a9b713-5691-4b12-8d6c-485e3f769985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:53.482675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:53.483548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:53.483989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:53.484429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] PATH_INFO: `/v3/projects/310c86f7dd3f4a0699b65b7ef8190d6b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:53.487492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=310c86f7dd3f4a0699b65b7ef8190d6b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:53.495330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:53.619979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 733/1450] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:42:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:42:53.648740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310c86f7dd3f4a0699b65b7ef8190d6b', 'request_id': 'req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:53.667598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310c86f7dd3f4a0699b65b7ef8190d6b', 'request_id': 'req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:53.697399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310c86f7dd3f4a0699b65b7ef8190d6b', 'request_id': 'req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:53.732111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] The token cache is being invalidate because project 310c86f7dd3f4a0699b65b7ef8190d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:53.732499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:53.734493 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ebb6448-2f12-4af9-80c6-ddba8e43dd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:53.738970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 718/1451] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:53 2022] DELETE /identity/v3/projects/310c86f7dd3f4a0699b65b7ef8190d6b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:53.742846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3570984-35f0-4723-a333-fae8e380a1e0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:53.743418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3570984-35f0-4723-a333-fae8e380a1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:53.743613 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3570984-35f0-4723-a333-fae8e380a1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:53.793619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b3570984-35f0-4723-a333-fae8e380a1e0 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:53.807013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b3570984-35f0-4723-a333-fae8e380a1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:53.917027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:53.930976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 734/1452] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:53.940007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9697a-9c7f-4d4e-9e86-892bca2373f8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:53.940459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9697a-9c7f-4d4e-9e86-892bca2373f8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:53.940994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9697a-9c7f-4d4e-9e86-892bca2373f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:53.977932 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-30d9697a-9c7f-4d4e-9e86-892bca2373f8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:53.979940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-30d9697a-9c7f-4d4e-9e86-892bca2373f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:53.991091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 719/1453] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:53.995588 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3570984-35f0-4723-a333-fae8e380a1e0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:54.016238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3570984-35f0-4723-a333-fae8e380a1e0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:54.031945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc552-b52e-4763-be4e-edb7115251e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:54.032703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc552-b52e-4763-be4e-edb7115251e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:54.033349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc552-b52e-4763-be4e-edb7115251e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:54.033702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc552-b52e-4763-be4e-edb7115251e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:54.034541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc552-b52e-4763-be4e-edb7115251e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:42:54.034962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc552-b52e-4763-be4e-edb7115251e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:54.037079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc552-b52e-4763-be4e-edb7115251e7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:54.063196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 735/1454] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:42:54.067865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9697a-9c7f-4d4e-9e86-892bca2373f8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:54.092581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9697a-9c7f-4d4e-9e86-892bca2373f8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:54.103948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02d62f-4527-416a-9806-4b4787419b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:54.104488 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02d62f-4527-416a-9806-4b4787419b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:54.105252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02d62f-4527-416a-9806-4b4787419b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:54.105604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02d62f-4527-416a-9806-4b4787419b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:54.106353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02d62f-4527-416a-9806-4b4787419b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:54.109075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02d62f-4527-416a-9806-4b4787419b09 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:54.193407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 720/1455] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:54 2022] POST /identity/v3/projects => generated 397 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:54.197581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc552-b52e-4763-be4e-edb7115251e7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:54.211808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc552-b52e-4763-be4e-edb7115251e7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:54.300045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02d62f-4527-416a-9806-4b4787419b09 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:54.307391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fc02d62f-4527-416a-9806-4b4787419b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:54.363791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d280ac2-511c-4dba-b2fc-687d9a872476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:54.364481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d280ac2-511c-4dba-b2fc-687d9a872476 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:54.364765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d280ac2-511c-4dba-b2fc-687d9a872476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:54.365393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d280ac2-511c-4dba-b2fc-687d9a872476 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:54.366242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d280ac2-511c-4dba-b2fc-687d9a872476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:54.368579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d280ac2-511c-4dba-b2fc-687d9a872476 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:54.428642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 736/1456] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:54 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:54.432844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d280ac2-511c-4dba-b2fc-687d9a872476 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:54.446806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d280ac2-511c-4dba-b2fc-687d9a872476 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:54.453311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de80b9-c0fc-4456-9616-1ab29450e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:54.454138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de80b9-c0fc-4456-9616-1ab29450e4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:54.454575 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de80b9-c0fc-4456-9616-1ab29450e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:54.454865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de80b9-c0fc-4456-9616-1ab29450e4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:54.456052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de80b9-c0fc-4456-9616-1ab29450e4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:54.461795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de80b9-c0fc-4456-9616-1ab29450e4f8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:54.510140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 737/1457] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:54.511271 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de80b9-c0fc-4456-9616-1ab29450e4f8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:54.535430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de80b9-c0fc-4456-9616-1ab29450e4f8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:54.543407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09938-7383-4e34-8dd9-71e6e7aa18c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:54.544040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09938-7383-4e34-8dd9-71e6e7aa18c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:54.544316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09938-7383-4e34-8dd9-71e6e7aa18c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:54.544610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09938-7383-4e34-8dd9-71e6e7aa18c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:54.545279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b09938-7383-4e34-8dd9-71e6e7aa18c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:54.548354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b09938-7383-4e34-8dd9-71e6e7aa18c9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:54.553862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02d62f-4527-416a-9806-4b4787419b09 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:54.566785 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 738/1458] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:54.571322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09938-7383-4e34-8dd9-71e6e7aa18c9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:54.581197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e29920-167f-4f79-b576-6a76aa4d921d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:54.581197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e29920-167f-4f79-b576-6a76aa4d921d service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:54.581197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e29920-167f-4f79-b576-6a76aa4d921d service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:54.581197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e29920-167f-4f79-b576-6a76aa4d921d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:54.586649 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09938-7383-4e34-8dd9-71e6e7aa18c9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:54.588936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-64e29920-167f-4f79-b576-6a76aa4d921d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:54.594774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f2049-0794-45c2-b5c4-ad51a1a68b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:54.595852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f2049-0794-45c2-b5c4-ad51a1a68b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:54.596260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f2049-0794-45c2-b5c4-ad51a1a68b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:54.596687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f2049-0794-45c2-b5c4-ad51a1a68b1b admin admin] PATH_INFO: `/v3/projects/9b7c9c0f31ca46ed9197ec26b601afa7/users/32396abbcfc143dfa18b5a56401050ae/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:54.618254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f2049-0794-45c2-b5c4-ad51a1a68b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7c9c0f31ca46ed9197ec26b601afa7, user_id=32396abbcfc143dfa18b5a56401050ae, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:54.620120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e29920-167f-4f79-b576-6a76aa4d921d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:54.621840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e29920-167f-4f79-b576-6a76aa4d921d service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:54.622985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f2049-0794-45c2-b5c4-ad51a1a68b1b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:54.660965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 721/1459] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:54.673801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 739/1460] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:54 2022] PUT /identity/v3/projects/9b7c9c0f31ca46ed9197ec26b601afa7/users/32396abbcfc143dfa18b5a56401050ae/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:54.686338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb7524-2f64-41b7-a8a5-3250e31968a1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:54.686583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb7524-2f64-41b7-a8a5-3250e31968a1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:54.686888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb7524-2f64-41b7-a8a5-3250e31968a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:54.792050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-accb7524-2f64-41b7-a8a5-3250e31968a1 None None] MFA Rules not processed for user `32396abbcfc143dfa18b5a56401050ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:54.793385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-accb7524-2f64-41b7-a8a5-3250e31968a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:54.807402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:54.973523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 722/1461] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:54.980076 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f2049-0794-45c2-b5c4-ad51a1a68b1b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:55.117882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f2049-0794-45c2-b5c4-ad51a1a68b1b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:55.129623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510a6b-19cc-47cf-86f3-c80358c97460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:55.132268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb7524-2f64-41b7-a8a5-3250e31968a1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:55.133869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510a6b-19cc-47cf-86f3-c80358c97460 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:55.133987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-accb7524-2f64-41b7-a8a5-3250e31968a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:55.134170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510a6b-19cc-47cf-86f3-c80358c97460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:55.134502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510a6b-19cc-47cf-86f3-c80358c97460 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:55.138623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75510a6b-19cc-47cf-86f3-c80358c97460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:55.142525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75510a6b-19cc-47cf-86f3-c80358c97460 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:55.205667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 740/1462] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:42:54 2022] POST /identity/v3/projects => generated 401 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:55.207064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510a6b-19cc-47cf-86f3-c80358c97460 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:55.231646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:55.286647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb7524-2f64-41b7-a8a5-3250e31968a1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:55.310204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510a6b-19cc-47cf-86f3-c80358c97460 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:55.316944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb9c5c-8ac6-4a27-9dd9-12861472594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:55.318140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb9c5c-8ac6-4a27-9dd9-12861472594a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:55.318451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb9c5c-8ac6-4a27-9dd9-12861472594a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:55.318811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb9c5c-8ac6-4a27-9dd9-12861472594a admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:55.319540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb9c5c-8ac6-4a27-9dd9-12861472594a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:55.322753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb9c5c-8ac6-4a27-9dd9-12861472594a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:55.358848 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 741/1463] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:42:55 2022] POST /identity/v3/users => generated 307 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:42:55.364504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb9c5c-8ac6-4a27-9dd9-12861472594a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:55.397949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990463-04e9-4150-b50d-0a0c2448fa62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:55.398481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb9c5c-8ac6-4a27-9dd9-12861472594a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:55.398577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990463-04e9-4150-b50d-0a0c2448fa62 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:55.398838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990463-04e9-4150-b50d-0a0c2448fa62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:55.399128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990463-04e9-4150-b50d-0a0c2448fa62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:55.405329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48717c-68bf-4b7e-816f-9e9021fe2bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:55.405329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48717c-68bf-4b7e-816f-9e9021fe2bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:55.405704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48717c-68bf-4b7e-816f-9e9021fe2bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:55.405801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48717c-68bf-4b7e-816f-9e9021fe2bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:55.406506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48717c-68bf-4b7e-816f-9e9021fe2bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:55.409795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48717c-68bf-4b7e-816f-9e9021fe2bcf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:55.410110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8d990463-04e9-4150-b50d-0a0c2448fa62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:55.432199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 742/1464] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:55.433659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48717c-68bf-4b7e-816f-9e9021fe2bcf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:55.453629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48717c-68bf-4b7e-816f-9e9021fe2bcf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:55.464347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173ad23-25e7-40a3-86ee-19fe62e76998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:55.465618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173ad23-25e7-40a3-86ee-19fe62e76998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:55.466154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173ad23-25e7-40a3-86ee-19fe62e76998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:55.466687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173ad23-25e7-40a3-86ee-19fe62e76998 admin admin] PATH_INFO: `/v3/projects/4467d376a60243cf854e2895087382ce/users/d9bfe43b16c24a5cb23268b3764053b3/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:55.492700 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173ad23-25e7-40a3-86ee-19fe62e76998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4467d376a60243cf854e2895087382ce, user_id=d9bfe43b16c24a5cb23268b3764053b3, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:55.498067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173ad23-25e7-40a3-86ee-19fe62e76998 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:55.530728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 743/1465] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:55 2022] PUT /identity/v3/projects/4467d376a60243cf854e2895087382ce/users/d9bfe43b16c24a5cb23268b3764053b3/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:55.532382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173ad23-25e7-40a3-86ee-19fe62e76998 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:55.545469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d990463-04e9-4150-b50d-0a0c2448fa62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:55.546875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d990463-04e9-4150-b50d-0a0c2448fa62 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:55.563467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 723/1466] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:55.636937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173ad23-25e7-40a3-86ee-19fe62e76998 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:55.644751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c0220-59cb-4aa5-b98d-c5bda41a9158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:55.645657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c0220-59cb-4aa5-b98d-c5bda41a9158 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:55.645940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c0220-59cb-4aa5-b98d-c5bda41a9158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:55.646213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c0220-59cb-4aa5-b98d-c5bda41a9158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:55.647454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c0220-59cb-4aa5-b98d-c5bda41a9158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:55.649077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c0220-59cb-4aa5-b98d-c5bda41a9158 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:55.668950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 744/1467] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:42:55.669848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990463-04e9-4150-b50d-0a0c2448fa62 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:55.691639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990463-04e9-4150-b50d-0a0c2448fa62 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:55.707394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12644d8-72f2-4a89-8897-ef99e1b41605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:55.708085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12644d8-72f2-4a89-8897-ef99e1b41605 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:55.708363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12644d8-72f2-4a89-8897-ef99e1b41605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:55.708632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12644d8-72f2-4a89-8897-ef99e1b41605 admin admin] PATH_INFO: `/v3/projects/4467d376a60243cf854e2895087382ce/users/d9bfe43b16c24a5cb23268b3764053b3/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:55.713563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12644d8-72f2-4a89-8897-ef99e1b41605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4467d376a60243cf854e2895087382ce, user_id=d9bfe43b16c24a5cb23268b3764053b3, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:55.731541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12644d8-72f2-4a89-8897-ef99e1b41605 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:55.748190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:55.757909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 724/1468] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:42:55 2022] PUT /identity/v3/projects/4467d376a60243cf854e2895087382ce/users/d9bfe43b16c24a5cb23268b3764053b3/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:42:55.771044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f2fc1-1763-40b1-a994-0833b66ad040 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:55.771578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f2fc1-1763-40b1-a994-0833b66ad040 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:55.772134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f2fc1-1763-40b1-a994-0833b66ad040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:55.848362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f83f2fc1-1763-40b1-a994-0833b66ad040 None None] MFA Rules not processed for user `d9bfe43b16c24a5cb23268b3764053b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:55.849840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f83f2fc1-1763-40b1-a994-0833b66ad040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:56.001490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:56.067248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 745/1469] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:55 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:42:56.100031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12644d8-72f2-4a89-8897-ef99e1b41605 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:56.103333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f12644d8-72f2-4a89-8897-ef99e1b41605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:56.191276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12644d8-72f2-4a89-8897-ef99e1b41605 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:56.195271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174e5e-006f-4489-bf2a-3b6959cf89cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:56.195888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174e5e-006f-4489-bf2a-3b6959cf89cb service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:56.196162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174e5e-006f-4489-bf2a-3b6959cf89cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:56.196427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174e5e-006f-4489-bf2a-3b6959cf89cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:56.212076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3174e5e-006f-4489-bf2a-3b6959cf89cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:56.214058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3174e5e-006f-4489-bf2a-3b6959cf89cb service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:56.245722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 725/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:56 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:56.415893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f2fc1-1763-40b1-a994-0833b66ad040 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:56.439133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f2fc1-1763-40b1-a994-0833b66ad040 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:56.446918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d1181-253c-4738-9700-ef09c861845a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:56.447570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1181-253c-4738-9700-ef09c861845a service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:56.447844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1181-253c-4738-9700-ef09c861845a service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:56.448114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1181-253c-4738-9700-ef09c861845a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:56.554483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d1181-253c-4738-9700-ef09c861845a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:56.556080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d1181-253c-4738-9700-ef09c861845a service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:56.577092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 746/1471] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:57.547133 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed4d8-f5c5-4f4c-b270-cc1acc220678 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:57.547566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed4d8-f5c5-4f4c-b270-cc1acc220678 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:57.547642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed4d8-f5c5-4f4c-b270-cc1acc220678 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:57.549155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 726/1472] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:42:57.568675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e669c30-2f11-488d-8561-d343075a8f8a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:57.569187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e669c30-2f11-488d-8561-d343075a8f8a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:57.569278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e669c30-2f11-488d-8561-d343075a8f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:57.601930 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4e669c30-2f11-488d-8561-d343075a8f8a None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:57.603385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4e669c30-2f11-488d-8561-d343075a8f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:57.697830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 747/1473] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:42:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:57.698688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed4d8-f5c5-4f4c-b270-cc1acc220678 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:57.726121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed4d8-f5c5-4f4c-b270-cc1acc220678 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:57.743669 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85980-bf8a-43f5-bb75-12d8655eea4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:57.744319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85980-bf8a-43f5-bb75-12d8655eea4a service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:57.744574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85980-bf8a-43f5-bb75-12d8655eea4a service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:57.744841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85980-bf8a-43f5-bb75-12d8655eea4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:57.773646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f85980-bf8a-43f5-bb75-12d8655eea4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:57.775545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f85980-bf8a-43f5-bb75-12d8655eea4a service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:57.793378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 727/1474] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:42:58.473677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e669c30-2f11-488d-8561-d343075a8f8a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:58.483027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4e669c30-2f11-488d-8561-d343075a8f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:58.661880 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e669c30-2f11-488d-8561-d343075a8f8a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:58.667334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:58.668743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:58.669199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:58.669950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] PATH_INFO: `/v3/users/bbb8d023efe745248117c9c51521a63e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:58.671582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb8d023efe745248117c9c51521a63e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:58.673605 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:58.707537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:58.759300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb8d023efe745248117c9c51521a63e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:58.760056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb8d023efe745248117c9c51521a63e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:58.771427 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb8d023efe745248117c9c51521a63e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:58.788355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb8d023efe745248117c9c51521a63e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:58.790057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb8d023efe745248117c9c51521a63e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:58.821996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 748/1475] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:58 2022] DELETE /identity/v3/users/bbb8d023efe745248117c9c51521a63e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:58.823181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9f519-01ba-4421-8834-bae972f1f1ea None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:58.823643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9f519-01ba-4421-8834-bae972f1f1ea None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:58.823643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9f519-01ba-4421-8834-bae972f1f1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:58.847862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ebe9f519-01ba-4421-8834-bae972f1f1ea None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:42:58.858443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ebe9f519-01ba-4421-8834-bae972f1f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:58.985070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 728/1476] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:42:58.998604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:59.000135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:59.079158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883177e-ce67-476f-b41e-780bdba7e910 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:59.083878 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44decb8-b011-42af-a906-1a26d007f921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:59.085257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44decb8-b011-42af-a906-1a26d007f921 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:59.085539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44decb8-b011-42af-a906-1a26d007f921 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:59.085807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44decb8-b011-42af-a906-1a26d007f921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:59.099056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44decb8-b011-42af-a906-1a26d007f921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:59.101199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44decb8-b011-42af-a906-1a26d007f921 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:59.115238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 749/1477] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:42:59.525250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9f519-01ba-4421-8834-bae972f1f1ea None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:59.528417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ebe9f519-01ba-4421-8834-bae972f1f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:42:59.570437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9f519-01ba-4421-8834-bae972f1f1ea None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:59.577452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:59.578361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:59.579006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:59.579735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] PATH_INFO: `/v3/projects/6178d5d985ee4559834774f0b934ca42` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:59.582129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6178d5d985ee4559834774f0b934ca42)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:59.584353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:59.681359 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6178d5d985ee4559834774f0b934ca42', 'request_id': 'req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.692312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6178d5d985ee4559834774f0b934ca42', 'request_id': 'req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.699555 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6178d5d985ee4559834774f0b934ca42', 'request_id': 'req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.727005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] The token cache is being invalidate because project 6178d5d985ee4559834774f0b934ca42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:42:59.727377 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.728105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.729636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 729/1478] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:42:59 2022] DELETE /identity/v3/projects/6178d5d985ee4559834774f0b934ca42 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:42:59.734853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44decb8-b011-42af-a906-1a26d007f921 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:42:59.747242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44decb8-b011-42af-a906-1a26d007f921 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:42:59.822012 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:42:59.822960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:42:59.823471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:42:59.824005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] PATH_INFO: `/v3/users/1c4fc404f8e14b85b4c052f681ef5601` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:42:59.825433 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4fc404f8e14b85b4c052f681ef5601)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:42:59.827804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:42:59.899923 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:59.907965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4fc404f8e14b85b4c052f681ef5601'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.908648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4fc404f8e14b85b4c052f681ef5601'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.923804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4fc404f8e14b85b4c052f681ef5601'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.940779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4fc404f8e14b85b4c052f681ef5601'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.941581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e9f7d4bd-67b6-40b2-8d16-5916569e0d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4fc404f8e14b85b4c052f681ef5601'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:42:59.972778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 750/1479] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:42:59 2022] DELETE /identity/v3/users/1c4fc404f8e14b85b4c052f681ef5601 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:00.455566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:00.457105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:00.475317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0518fb-23b0-4a54-9ee8-b4dfef99cef5 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:00.485198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:00.534352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:00.535033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:00.535313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:00.535669 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] PATH_INFO: `/v3/projects/ed1c9db16cb44b24ad835824956bd321` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:00.536840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1c9db16cb44b24ad835824956bd321)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:00.538800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:00.588685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1c9db16cb44b24ad835824956bd321', 'request_id': 'req-17217b3d-b973-4d3c-b078-fc5ae59f7012'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:00.595045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1c9db16cb44b24ad835824956bd321', 'request_id': 'req-17217b3d-b973-4d3c-b078-fc5ae59f7012'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:00.600946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1c9db16cb44b24ad835824956bd321', 'request_id': 'req-17217b3d-b973-4d3c-b078-fc5ae59f7012'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:00.615827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] The token cache is being invalidate because project ed1c9db16cb44b24ad835824956bd321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:00.616123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:00.616788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17217b3d-b973-4d3c-b078-fc5ae59f7012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:00.618318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 730/1480] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:00 2022] DELETE /identity/v3/projects/ed1c9db16cb44b24ad835824956bd321 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:00.623595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b8b3-1cf7-4dfa-94a0-e905a907ced9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:00.623857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b8b3-1cf7-4dfa-94a0-e905a907ced9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:00.624141 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b8b3-1cf7-4dfa-94a0-e905a907ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:00.644309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3929b8b3-1cf7-4dfa-94a0-e905a907ced9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:00.645438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3929b8b3-1cf7-4dfa-94a0-e905a907ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:00.707252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 751/1481] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:00.715324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a52eae-a241-4813-8c44-4adbb63247f3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:00.715631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a52eae-a241-4813-8c44-4adbb63247f3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:00.715897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a52eae-a241-4813-8c44-4adbb63247f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:00.737118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d2a52eae-a241-4813-8c44-4adbb63247f3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:00.738332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d2a52eae-a241-4813-8c44-4adbb63247f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:00.746487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 731/1482] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:00.751478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b8b3-1cf7-4dfa-94a0-e905a907ced9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:00.762598 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b8b3-1cf7-4dfa-94a0-e905a907ced9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:00.768549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f2bda-9978-47ed-af2e-e4ebae31d31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:00.769163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f2bda-9978-47ed-af2e-e4ebae31d31a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:00.769437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f2bda-9978-47ed-af2e-e4ebae31d31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:00.769702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f2bda-9978-47ed-af2e-e4ebae31d31a admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:00.770342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f2bda-9978-47ed-af2e-e4ebae31d31a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:00.770669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f2bda-9978-47ed-af2e-e4ebae31d31a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:00.772312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f2bda-9978-47ed-af2e-e4ebae31d31a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:00.784796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 752/1483] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:00.789417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a52eae-a241-4813-8c44-4adbb63247f3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:00.799189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a52eae-a241-4813-8c44-4adbb63247f3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:00.805698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb7c0a-1b28-4f54-a199-8fc4c1cf2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:00.806374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb7c0a-1b28-4f54-a199-8fc4c1cf2953 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:00.807570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb7c0a-1b28-4f54-a199-8fc4c1cf2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:00.807995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb7c0a-1b28-4f54-a199-8fc4c1cf2953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:00.808634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb7c0a-1b28-4f54-a199-8fc4c1cf2953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:00.810962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb7c0a-1b28-4f54-a199-8fc4c1cf2953 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:00.849280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 732/1484] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:00 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:00.855485 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f2bda-9978-47ed-af2e-e4ebae31d31a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:00.867433 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f2bda-9978-47ed-af2e-e4ebae31d31a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:00.934273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49a4b4-7d7d-47db-9414-005601695ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:00.934953 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49a4b4-7d7d-47db-9414-005601695ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:00.935298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49a4b4-7d7d-47db-9414-005601695ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:00.935588 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49a4b4-7d7d-47db-9414-005601695ccf admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:00.936283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49a4b4-7d7d-47db-9414-005601695ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:00.938512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49a4b4-7d7d-47db-9414-005601695ccf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:00.963296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 753/1485] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:00 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:00.967934 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb7c0a-1b28-4f54-a199-8fc4c1cf2953 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:00.981183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb7c0a-1b28-4f54-a199-8fc4c1cf2953 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:00.986873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ace78-347b-4def-a716-2392dc1047d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:00.987517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ace78-347b-4def-a716-2392dc1047d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:00.989376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ace78-347b-4def-a716-2392dc1047d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:00.989648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ace78-347b-4def-a716-2392dc1047d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:00.990332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ace78-347b-4def-a716-2392dc1047d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:00.992057 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ace78-347b-4def-a716-2392dc1047d2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:01.002914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 733/1486] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:01.007118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49a4b4-7d7d-47db-9414-005601695ccf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:01.018473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49a4b4-7d7d-47db-9414-005601695ccf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:01.024257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd04300-66f5-4346-b48d-75711f62bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:01.025636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd04300-66f5-4346-b48d-75711f62bd21 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.026006 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd04300-66f5-4346-b48d-75711f62bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.026368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd04300-66f5-4346-b48d-75711f62bd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.027144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd04300-66f5-4346-b48d-75711f62bd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:01.028849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd04300-66f5-4346-b48d-75711f62bd21 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:01.041360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 754/1487] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:01.045792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ace78-347b-4def-a716-2392dc1047d2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:01.059364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ace78-347b-4def-a716-2392dc1047d2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:01.091485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edbbd8-39e3-4f71-bc9f-b182a174914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:01.095448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edbbd8-39e3-4f71-bc9f-b182a174914f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.096873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edbbd8-39e3-4f71-bc9f-b182a174914f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.098072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edbbd8-39e3-4f71-bc9f-b182a174914f admin admin] PATH_INFO: `/v3/projects/4866ae5cd5f24de3a4b89d5146f57ac5/users/1e4fa97aadd14ef29154ca5c122ceda9/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.122029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edbbd8-39e3-4f71-bc9f-b182a174914f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4866ae5cd5f24de3a4b89d5146f57ac5, user_id=1e4fa97aadd14ef29154ca5c122ceda9, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:01.127215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edbbd8-39e3-4f71-bc9f-b182a174914f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:01.155099 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 734/1488] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:01 2022] PUT /identity/v3/projects/4866ae5cd5f24de3a4b89d5146f57ac5/users/1e4fa97aadd14ef29154ca5c122ceda9/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:01.166547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d315098-c3cf-4c6a-8991-e0889cb18180 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.166886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d315098-c3cf-4c6a-8991-e0889cb18180 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.167151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d315098-c3cf-4c6a-8991-e0889cb18180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.213784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edbbd8-39e3-4f71-bc9f-b182a174914f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:01.215847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a3edbbd8-39e3-4f71-bc9f-b182a174914f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:01.227940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4d315098-c3cf-4c6a-8991-e0889cb18180 None None] MFA Rules not processed for user `1e4fa97aadd14ef29154ca5c122ceda9`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:01.229423 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4d315098-c3cf-4c6a-8991-e0889cb18180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:01.273415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:01.285989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:01.303959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edbbd8-39e3-4f71-bc9f-b182a174914f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:01.313976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:01.315135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.316003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.316508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] PATH_INFO: `/v3/users/32396abbcfc143dfa18b5a56401050ae` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.318578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32396abbcfc143dfa18b5a56401050ae)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:01.322395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:01.410068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 755/1489] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:01.414608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d315098-c3cf-4c6a-8991-e0889cb18180 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:01.432753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d315098-c3cf-4c6a-8991-e0889cb18180 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:01.439788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32396abbcfc143dfa18b5a56401050ae'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:01.440285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862d9d9-23e5-4705-a407-1a10e81e6e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:01.440983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862d9d9-23e5-4705-a407-1a10e81e6e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.441598 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862d9d9-23e5-4705-a407-1a10e81e6e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.441945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862d9d9-23e5-4705-a407-1a10e81e6e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.442826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862d9d9-23e5-4705-a407-1a10e81e6e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:01.443845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32396abbcfc143dfa18b5a56401050ae'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:01.445899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862d9d9-23e5-4705-a407-1a10e81e6e67 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:01.459697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32396abbcfc143dfa18b5a56401050ae'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:01.497206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 756/1490] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:01 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:01.502548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862d9d9-23e5-4705-a407-1a10e81e6e67 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:01.504861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32396abbcfc143dfa18b5a56401050ae'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:01.506213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a862d9d9-23e5-4705-a407-1a10e81e6e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:01.506745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51c6b8dc-c0ef-4531-9d29-e5b2dd1ed382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32396abbcfc143dfa18b5a56401050ae'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:01.543412 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 735/1491] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:01 2022] DELETE /identity/v3/users/32396abbcfc143dfa18b5a56401050ae => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:01.549333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c968-37fd-47fd-8ead-191ed21ff7ed None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.549333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c968-37fd-47fd-8ead-191ed21ff7ed None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.549588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c968-37fd-47fd-8ead-191ed21ff7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.602423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5585c968-37fd-47fd-8ead-191ed21ff7ed None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:01.607355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5585c968-37fd-47fd-8ead-191ed21ff7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:01.677450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862d9d9-23e5-4705-a407-1a10e81e6e67 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:01.692008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 736/1492] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:01.704582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585c968-37fd-47fd-8ead-191ed21ff7ed None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:01.721894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5585c968-37fd-47fd-8ead-191ed21ff7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:01.823889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfaf52-8971-44a0-abfa-e656c9541d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:01.824618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfaf52-8971-44a0-abfa-e656c9541d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.827032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfaf52-8971-44a0-abfa-e656c9541d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.827328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfaf52-8971-44a0-abfa-e656c9541d04 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.830476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfaf52-8971-44a0-abfa-e656c9541d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:01.837597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfaf52-8971-44a0-abfa-e656c9541d04 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:01.859267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585c968-37fd-47fd-8ead-191ed21ff7ed None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:01.886142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd863cfc-f92a-47a3-a475-ddedb7a642db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:01.887636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd863cfc-f92a-47a3-a475-ddedb7a642db service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.887743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd863cfc-f92a-47a3-a475-ddedb7a642db service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.888008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd863cfc-f92a-47a3-a475-ddedb7a642db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.895307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 757/1493] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:01 2022] POST /identity/v3/users => generated 291 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:01.897616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfaf52-8971-44a0-abfa-e656c9541d04 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:01.909919 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfaf52-8971-44a0-abfa-e656c9541d04 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:01.915926 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b497cb-b469-4d60-aaf0-f39ec159c261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:01.916596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b497cb-b469-4d60-aaf0-f39ec159c261 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.918021 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b497cb-b469-4d60-aaf0-f39ec159c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.918021 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b497cb-b469-4d60-aaf0-f39ec159c261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.918185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b497cb-b469-4d60-aaf0-f39ec159c261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:01.921713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b497cb-b469-4d60-aaf0-f39ec159c261 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:01.935285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 758/1494] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:01.939611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b497cb-b469-4d60-aaf0-f39ec159c261 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:01.944907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd863cfc-f92a-47a3-a475-ddedb7a642db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:01.955132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd863cfc-f92a-47a3-a475-ddedb7a642db service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:01.961852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b497cb-b469-4d60-aaf0-f39ec159c261 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:01.967648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff913f7-deda-45a4-bd35-c9ef90ea534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:01.968478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff913f7-deda-45a4-bd35-c9ef90ea534e admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:01.968848 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff913f7-deda-45a4-bd35-c9ef90ea534e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:01.969262 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff913f7-deda-45a4-bd35-c9ef90ea534e admin admin] PATH_INFO: `/v3/projects/a2f23327aed14dd8a9e1a599f6047ebd/users/11fabfa958e4444eb446a18565a7a0c8/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:01.989354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff913f7-deda-45a4-bd35-c9ef90ea534e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f23327aed14dd8a9e1a599f6047ebd, user_id=11fabfa958e4444eb446a18565a7a0c8, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:01.992681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff913f7-deda-45a4-bd35-c9ef90ea534e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:01.996842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:02.001712 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 737/1495] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:02.019560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 759/1496] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:01 2022] PUT /identity/v3/projects/a2f23327aed14dd8a9e1a599f6047ebd/users/11fabfa958e4444eb446a18565a7a0c8/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:02.023720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd863cfc-f92a-47a3-a475-ddedb7a642db service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:02.029862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:02.041270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd863cfc-f92a-47a3-a475-ddedb7a642db service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:02.162482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38de3e-952f-4e0c-b1d9-47e9e83c97f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:02.163282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38de3e-952f-4e0c-b1d9-47e9e83c97f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:02.163705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38de3e-952f-4e0c-b1d9-47e9e83c97f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:02.164062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38de3e-952f-4e0c-b1d9-47e9e83c97f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:02.165067 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38de3e-952f-4e0c-b1d9-47e9e83c97f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:02.166701 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38de3e-952f-4e0c-b1d9-47e9e83c97f9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:02.182307 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 738/1497] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:02.189311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff913f7-deda-45a4-bd35-c9ef90ea534e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:02.202362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff913f7-deda-45a4-bd35-c9ef90ea534e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:02.208449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeff6b-1227-4a96-8b56-e16ed7693d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:02.209132 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeff6b-1227-4a96-8b56-e16ed7693d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:02.209756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeff6b-1227-4a96-8b56-e16ed7693d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:02.209913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeff6b-1227-4a96-8b56-e16ed7693d98 admin admin] PATH_INFO: `/v3/projects/a2f23327aed14dd8a9e1a599f6047ebd/users/11fabfa958e4444eb446a18565a7a0c8/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:02.212300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeff6b-1227-4a96-8b56-e16ed7693d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f23327aed14dd8a9e1a599f6047ebd, user_id=11fabfa958e4444eb446a18565a7a0c8, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:02.215252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeff6b-1227-4a96-8b56-e16ed7693d98 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:02.228091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 760/1498] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:02 2022] PUT /identity/v3/projects/a2f23327aed14dd8a9e1a599f6047ebd/users/11fabfa958e4444eb446a18565a7a0c8/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:02.238775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875050-07c0-4333-b9c4-6a72940eb837 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:02.239078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875050-07c0-4333-b9c4-6a72940eb837 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:02.239356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875050-07c0-4333-b9c4-6a72940eb837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:02.277071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7a875050-07c0-4333-b9c4-6a72940eb837 None None] MFA Rules not processed for user `11fabfa958e4444eb446a18565a7a0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:02.278699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7a875050-07c0-4333-b9c4-6a72940eb837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:02.367868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 739/1499] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:02.396627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeff6b-1227-4a96-8b56-e16ed7693d98 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:02.401458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-acbeff6b-1227-4a96-8b56-e16ed7693d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:02.477620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeff6b-1227-4a96-8b56-e16ed7693d98 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:02.482211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e002b-c896-4dd8-86fe-1b28bfd15252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:02.482842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e002b-c896-4dd8-86fe-1b28bfd15252 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:02.483137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e002b-c896-4dd8-86fe-1b28bfd15252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:02.483627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e002b-c896-4dd8-86fe-1b28bfd15252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:02.494099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e002b-c896-4dd8-86fe-1b28bfd15252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:02.495701 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e002b-c896-4dd8-86fe-1b28bfd15252 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:02.507049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 761/1500] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:02.559296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a875050-07c0-4333-b9c4-6a72940eb837 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:02.560812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7a875050-07c0-4333-b9c4-6a72940eb837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:02.573940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a875050-07c0-4333-b9c4-6a72940eb837 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:02.578646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fa9e7-5a62-40a6-a1e4-c23ce58fa8dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:02.579545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa9e7-5a62-40a6-a1e4-c23ce58fa8dd service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:02.579892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa9e7-5a62-40a6-a1e4-c23ce58fa8dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:02.580228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa9e7-5a62-40a6-a1e4-c23ce58fa8dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:02.582505 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e96fa9e7-5a62-40a6-a1e4-c23ce58fa8dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:02.682313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fa9e7-5a62-40a6-a1e4-c23ce58fa8dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:02.683750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fa9e7-5a62-40a6-a1e4-c23ce58fa8dd service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:02.699079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 740/1501] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:03.120217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e002b-c896-4dd8-86fe-1b28bfd15252 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:03.122361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0d2e002b-c896-4dd8-86fe-1b28bfd15252 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:03.228117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e002b-c896-4dd8-86fe-1b28bfd15252 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:03.233185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:03.233913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:03.234241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:03.234575 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] PATH_INFO: `/v3/projects/9b7c9c0f31ca46ed9197ec26b601afa7` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:03.235782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7c9c0f31ca46ed9197ec26b601afa7)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:03.237758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:03.305204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7c9c0f31ca46ed9197ec26b601afa7', 'request_id': 'req-c15d777b-935d-4226-abd0-ae412e1ced4b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.314005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7c9c0f31ca46ed9197ec26b601afa7', 'request_id': 'req-c15d777b-935d-4226-abd0-ae412e1ced4b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.323625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7c9c0f31ca46ed9197ec26b601afa7', 'request_id': 'req-c15d777b-935d-4226-abd0-ae412e1ced4b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.339263 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] The token cache is being invalidate because project 9b7c9c0f31ca46ed9197ec26b601afa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:03.339456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.339979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.344689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 762/1502] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:03 2022] DELETE /identity/v3/projects/9b7c9c0f31ca46ed9197ec26b601afa7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:03.346349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fa9e7-5a62-40a6-a1e4-c23ce58fa8dd service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:03.358819 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fa9e7-5a62-40a6-a1e4-c23ce58fa8dd service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:03.407037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:03.483360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:03.484167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:03.484399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:03.484734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] PATH_INFO: `/v3/users/d9bfe43b16c24a5cb23268b3764053b3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:03.486071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bfe43b16c24a5cb23268b3764053b3)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:03.488112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:03.555384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bfe43b16c24a5cb23268b3764053b3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.556047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bfe43b16c24a5cb23268b3764053b3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.565005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bfe43b16c24a5cb23268b3764053b3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.580555 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bfe43b16c24a5cb23268b3764053b3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.581286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ee4570a-6efd-45a4-98c3-071a5d80d650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bfe43b16c24a5cb23268b3764053b3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:03.599510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 741/1503] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:03 2022] DELETE /identity/v3/users/d9bfe43b16c24a5cb23268b3764053b3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:04.050963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:04.052777 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:04.067324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d777b-935d-4226-abd0-ae412e1ced4b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:04.080682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:04.157490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:04.158481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.158988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.163352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] PATH_INFO: `/v3/projects/4467d376a60243cf854e2895087382ce` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.165358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4467d376a60243cf854e2895087382ce)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:04.168441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:04.329130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4467d376a60243cf854e2895087382ce', 'request_id': 'req-181d7f6b-b577-4a98-8115-0a4ada9114d5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:04.343268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4467d376a60243cf854e2895087382ce', 'request_id': 'req-181d7f6b-b577-4a98-8115-0a4ada9114d5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:04.357490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4467d376a60243cf854e2895087382ce', 'request_id': 'req-181d7f6b-b577-4a98-8115-0a4ada9114d5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:04.388926 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] The token cache is being invalidate because project 4467d376a60243cf854e2895087382ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:04.389881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:04.391116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-181d7f6b-b577-4a98-8115-0a4ada9114d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:04.393044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 763/1504] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:04 2022] DELETE /identity/v3/projects/4467d376a60243cf854e2895087382ce => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:04.397925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96942e1e-2c57-47c0-a4d5-66dcbe28e19d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.398415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96942e1e-2c57-47c0-a4d5-66dcbe28e19d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.398841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96942e1e-2c57-47c0-a4d5-66dcbe28e19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.424857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-96942e1e-2c57-47c0-a4d5-66dcbe28e19d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:04.426073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96942e1e-2c57-47c0-a4d5-66dcbe28e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:04.502278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 742/1505] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:04.508973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca3b95-c96b-4e3c-a894-e238290f5369 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.509413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca3b95-c96b-4e3c-a894-e238290f5369 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.509685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca3b95-c96b-4e3c-a894-e238290f5369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.541404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5cca3b95-c96b-4e3c-a894-e238290f5369 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:04.542641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5cca3b95-c96b-4e3c-a894-e238290f5369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:04.554034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 764/1506] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:04.558156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96942e1e-2c57-47c0-a4d5-66dcbe28e19d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:04.569099 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96942e1e-2c57-47c0-a4d5-66dcbe28e19d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:04.574501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9854bc-7096-4d0c-b56a-a6a4de282f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:04.575626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9854bc-7096-4d0c-b56a-a6a4de282f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.575972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9854bc-7096-4d0c-b56a-a6a4de282f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.576950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9854bc-7096-4d0c-b56a-a6a4de282f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.577894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9854bc-7096-4d0c-b56a-a6a4de282f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:04.578575 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9854bc-7096-4d0c-b56a-a6a4de282f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:04.581736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9854bc-7096-4d0c-b56a-a6a4de282f1f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:04.600645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 743/1507] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:43:04.605644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca3b95-c96b-4e3c-a894-e238290f5369 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:04.617652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca3b95-c96b-4e3c-a894-e238290f5369 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:04.645200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1d2b5-ed02-495c-bf08-c658a376f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:04.646048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1d2b5-ed02-495c-bf08-c658a376f806 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.647772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1d2b5-ed02-495c-bf08-c658a376f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.648125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1d2b5-ed02-495c-bf08-c658a376f806 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.649907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1d2b5-ed02-495c-bf08-c658a376f806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:04.653414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1d2b5-ed02-495c-bf08-c658a376f806 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:04.704972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 765/1508] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:04 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:04.709361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9854bc-7096-4d0c-b56a-a6a4de282f1f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:04.719745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9854bc-7096-4d0c-b56a-a6a4de282f1f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:04.747734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:04.780230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4546b9-c3e7-4283-8fff-509963f05061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:04.780888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4546b9-c3e7-4283-8fff-509963f05061 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.781204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4546b9-c3e7-4283-8fff-509963f05061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.781517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4546b9-c3e7-4283-8fff-509963f05061 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.782128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4546b9-c3e7-4283-8fff-509963f05061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:04.784110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4546b9-c3e7-4283-8fff-509963f05061 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:04.810507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 744/1509] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:04 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:04.814664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1d2b5-ed02-495c-bf08-c658a376f806 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:04.827383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1d2b5-ed02-495c-bf08-c658a376f806 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:04.836205 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392f69c-f3a8-4b6f-8d26-e98ee383ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:04.836843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392f69c-f3a8-4b6f-8d26-e98ee383ae9c admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.837334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392f69c-f3a8-4b6f-8d26-e98ee383ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.837695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392f69c-f3a8-4b6f-8d26-e98ee383ae9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.838279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392f69c-f3a8-4b6f-8d26-e98ee383ae9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:04.840054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392f69c-f3a8-4b6f-8d26-e98ee383ae9c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:04.852227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 766/1510] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:04.856405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4546b9-c3e7-4283-8fff-509963f05061 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:04.867219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4546b9-c3e7-4283-8fff-509963f05061 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:04.871852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e855c64-bedf-4c2b-be28-7676816d99f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:04.872926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e855c64-bedf-4c2b-be28-7676816d99f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.873247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e855c64-bedf-4c2b-be28-7676816d99f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.873543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e855c64-bedf-4c2b-be28-7676816d99f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.874249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e855c64-bedf-4c2b-be28-7676816d99f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:04.875929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e855c64-bedf-4c2b-be28-7676816d99f4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:04.886686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 745/1511] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:04.891450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392f69c-f3a8-4b6f-8d26-e98ee383ae9c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:04.901479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392f69c-f3a8-4b6f-8d26-e98ee383ae9c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:04.906162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3682518-6063-4352-aa83-5e8833cc0ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:04.906801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682518-6063-4352-aa83-5e8833cc0ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.907106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682518-6063-4352-aa83-5e8833cc0ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.907861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682518-6063-4352-aa83-5e8833cc0ee7 admin admin] PATH_INFO: `/v3/projects/c9329fd70cea46c0b1c6a6235daf6d4c/users/3fc437e6f8b3469c92ed1446117c18cf/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.923374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3682518-6063-4352-aa83-5e8833cc0ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9329fd70cea46c0b1c6a6235daf6d4c, user_id=3fc437e6f8b3469c92ed1446117c18cf, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:04.926198 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3682518-6063-4352-aa83-5e8833cc0ee7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:04.940462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 767/1512] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:04 2022] PUT /identity/v3/projects/c9329fd70cea46c0b1c6a6235daf6d4c/users/3fc437e6f8b3469c92ed1446117c18cf/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:04.952473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a3a73-3509-454d-b563-7b375cd4dfed None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:04.952761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a3a73-3509-454d-b563-7b375cd4dfed None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:04.953037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a3a73-3509-454d-b563-7b375cd4dfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:04.981461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5d4a3a73-3509-454d-b563-7b375cd4dfed None None] MFA Rules not processed for user `3fc437e6f8b3469c92ed1446117c18cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:04.983082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5d4a3a73-3509-454d-b563-7b375cd4dfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:05.066522 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 746/1513] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:05.067761 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3682518-6063-4352-aa83-5e8833cc0ee7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:05.114791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:05.135005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3682518-6063-4352-aa83-5e8833cc0ee7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:05.140993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835a1d5-2de0-488b-b6a7-fef4f58334c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:05.141610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a1d5-2de0-488b-b6a7-fef4f58334c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:05.141883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a1d5-2de0-488b-b6a7-fef4f58334c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:05.142148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a1d5-2de0-488b-b6a7-fef4f58334c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:05.142776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835a1d5-2de0-488b-b6a7-fef4f58334c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:05.144802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835a1d5-2de0-488b-b6a7-fef4f58334c5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:05.173227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 768/1514] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:05 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:05.177495 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a3a73-3509-454d-b563-7b375cd4dfed None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:05.188247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a3a73-3509-454d-b563-7b375cd4dfed None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:05.245850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9717c-bf04-4d96-8bb3-a907b6454ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:05.246469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9717c-bf04-4d96-8bb3-a907b6454ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:05.246715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9717c-bf04-4d96-8bb3-a907b6454ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:05.247027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9717c-bf04-4d96-8bb3-a907b6454ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:05.247848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9717c-bf04-4d96-8bb3-a907b6454ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:05.249750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9717c-bf04-4d96-8bb3-a907b6454ce9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:05.275320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 747/1515] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:05 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:05.279571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835a1d5-2de0-488b-b6a7-fef4f58334c5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:05.291330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835a1d5-2de0-488b-b6a7-fef4f58334c5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:05.296394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e4436-beac-458c-b5a0-90dbe20fc460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:05.297015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e4436-beac-458c-b5a0-90dbe20fc460 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:05.297287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e4436-beac-458c-b5a0-90dbe20fc460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:05.297554 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e4436-beac-458c-b5a0-90dbe20fc460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:05.298190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e4436-beac-458c-b5a0-90dbe20fc460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:05.299840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e4436-beac-458c-b5a0-90dbe20fc460 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:05.310893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 769/1516] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:05.315248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9717c-bf04-4d96-8bb3-a907b6454ce9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:05.325854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9717c-bf04-4d96-8bb3-a907b6454ce9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:05.330967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e7052-5988-40d6-98c6-6628f25ce0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:05.331624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7052-5988-40d6-98c6-6628f25ce0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:05.331898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7052-5988-40d6-98c6-6628f25ce0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:05.332167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7052-5988-40d6-98c6-6628f25ce0b2 admin admin] PATH_INFO: `/v3/projects/dca4871dbc084813b43ee85313970a2d/users/e798c3ef341a4d2d9267c6bc9a7957a1/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:05.347228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e7052-5988-40d6-98c6-6628f25ce0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca4871dbc084813b43ee85313970a2d, user_id=e798c3ef341a4d2d9267c6bc9a7957a1, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:05.349868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e7052-5988-40d6-98c6-6628f25ce0b2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:05.367550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 748/1517] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:05 2022] PUT /identity/v3/projects/dca4871dbc084813b43ee85313970a2d/users/e798c3ef341a4d2d9267c6bc9a7957a1/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:05.371499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e4436-beac-458c-b5a0-90dbe20fc460 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:05.383806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e4436-beac-458c-b5a0-90dbe20fc460 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:05.452683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99186-f43c-423c-9fdc-c21b19bad6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:05.453305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99186-f43c-423c-9fdc-c21b19bad6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:05.453576 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99186-f43c-423c-9fdc-c21b19bad6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:05.453842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99186-f43c-423c-9fdc-c21b19bad6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:05.454474 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b99186-f43c-423c-9fdc-c21b19bad6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:05.456185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b99186-f43c-423c-9fdc-c21b19bad6b6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:05.466570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 770/1518] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:05.470707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e7052-5988-40d6-98c6-6628f25ce0b2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:05.476173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:05.481989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e7052-5988-40d6-98c6-6628f25ce0b2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:05.487706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74218-68a1-483a-b132-819f5cfb908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:05.488377 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74218-68a1-483a-b132-819f5cfb908a admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:05.488655 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74218-68a1-483a-b132-819f5cfb908a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:05.488925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74218-68a1-483a-b132-819f5cfb908a admin admin] PATH_INFO: `/v3/projects/dca4871dbc084813b43ee85313970a2d/users/e798c3ef341a4d2d9267c6bc9a7957a1/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:05.490823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e74218-68a1-483a-b132-819f5cfb908a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca4871dbc084813b43ee85313970a2d, user_id=e798c3ef341a4d2d9267c6bc9a7957a1, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:05.493497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e74218-68a1-483a-b132-819f5cfb908a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:05.504756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 749/1519] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:05 2022] PUT /identity/v3/projects/dca4871dbc084813b43ee85313970a2d/users/e798c3ef341a4d2d9267c6bc9a7957a1/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:05.515885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6e32-0632-4243-bae3-3b8a2195507e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:05.516171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6e32-0632-4243-bae3-3b8a2195507e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:05.516444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6e32-0632-4243-bae3-3b8a2195507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:05.546581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-04be6e32-0632-4243-bae3-3b8a2195507e None None] MFA Rules not processed for user `e798c3ef341a4d2d9267c6bc9a7957a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:05.547849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-04be6e32-0632-4243-bae3-3b8a2195507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:05.616798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 771/1520] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:05.628492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74218-68a1-483a-b132-819f5cfb908a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:05.630455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-72e74218-68a1-483a-b132-819f5cfb908a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:05.689516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74218-68a1-483a-b132-819f5cfb908a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:05.694946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37958e-fdc1-4d3b-a1ac-e47af343c2ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:05.695605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37958e-fdc1-4d3b-a1ac-e47af343c2ef service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:05.695879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37958e-fdc1-4d3b-a1ac-e47af343c2ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:05.696144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37958e-fdc1-4d3b-a1ac-e47af343c2ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:05.708647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37958e-fdc1-4d3b-a1ac-e47af343c2ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:05.710291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37958e-fdc1-4d3b-a1ac-e47af343c2ef service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:05.721040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 750/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:05.975032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6e32-0632-4243-bae3-3b8a2195507e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:06.022333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:06.046997 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6e32-0632-4243-bae3-3b8a2195507e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:06.051664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:06.052419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:06.052763 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:06.053116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] PATH_INFO: `/v3/users/3fc437e6f8b3469c92ed1446117c18cf` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:06.054296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc437e6f8b3469c92ed1446117c18cf)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:06.056356 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:06.106168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc437e6f8b3469c92ed1446117c18cf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.106890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc437e6f8b3469c92ed1446117c18cf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.115134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc437e6f8b3469c92ed1446117c18cf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.130574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc437e6f8b3469c92ed1446117c18cf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.132075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc437e6f8b3469c92ed1446117c18cf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.149789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 772/1522] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:05 2022] DELETE /identity/v3/users/3fc437e6f8b3469c92ed1446117c18cf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:06.155125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed711f1-66bf-43c8-b31a-7fd8b1645be9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:06.155486 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed711f1-66bf-43c8-b31a-7fd8b1645be9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:06.155766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed711f1-66bf-43c8-b31a-7fd8b1645be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:06.179840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8ed711f1-66bf-43c8-b31a-7fd8b1645be9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:06.181202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8ed711f1-66bf-43c8-b31a-7fd8b1645be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:06.260989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 751/1523] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:06.277523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:06.280663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:06.350051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd0bd1-81bc-4f1a-8f53-c14fd142d84c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:06.362898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961baaa7-71db-4bc4-b0d4-8ea94da07ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:06.363967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961baaa7-71db-4bc4-b0d4-8ea94da07ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:06.364264 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961baaa7-71db-4bc4-b0d4-8ea94da07ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:06.364502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961baaa7-71db-4bc4-b0d4-8ea94da07ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:06.385235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961baaa7-71db-4bc4-b0d4-8ea94da07ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:06.386797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961baaa7-71db-4bc4-b0d4-8ea94da07ad1 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:06.398966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 773/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:06.542983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed711f1-66bf-43c8-b31a-7fd8b1645be9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:06.544428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8ed711f1-66bf-43c8-b31a-7fd8b1645be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:06.557712 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed711f1-66bf-43c8-b31a-7fd8b1645be9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:06.562704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:06.563366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:06.563637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:06.563899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] PATH_INFO: `/v3/users/1e4fa97aadd14ef29154ca5c122ceda9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:06.565019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4fa97aadd14ef29154ca5c122ceda9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:06.566939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:06.624340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4fa97aadd14ef29154ca5c122ceda9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.625043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4fa97aadd14ef29154ca5c122ceda9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.633295 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4fa97aadd14ef29154ca5c122ceda9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.647614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4fa97aadd14ef29154ca5c122ceda9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.648375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4fa97aadd14ef29154ca5c122ceda9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:06.672191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 752/1525] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:06 2022] DELETE /identity/v3/users/1e4fa97aadd14ef29154ca5c122ceda9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:06.676746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f167a-61b9-460f-ac72-6e2f01665cc8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:06.677098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f167a-61b9-460f-ac72-6e2f01665cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:06.677531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f167a-61b9-460f-ac72-6e2f01665cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:06.697852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-600f167a-61b9-460f-ac72-6e2f01665cc8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:06.699111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-600f167a-61b9-460f-ac72-6e2f01665cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:06.737610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:06.739964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:06.748988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:06.754627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:06.772407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 774/1526] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:06.782524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f167a-61b9-460f-ac72-6e2f01665cc8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:06.784283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-600f167a-61b9-460f-ac72-6e2f01665cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:06.865341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83648b-09cb-4b40-9142-9d43bea91425 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:06.869981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f167a-61b9-460f-ac72-6e2f01665cc8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:06.872305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:06.873074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:06.873507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:06.873785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] PATH_INFO: `/v3/projects/c9329fd70cea46c0b1c6a6235daf6d4c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:06.875066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9329fd70cea46c0b1c6a6235daf6d4c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:06.876378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbafb6a-7009-4c2d-9384-4462f1ccf9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:06.877277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbafb6a-7009-4c2d-9384-4462f1ccf9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:06.877889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbafb6a-7009-4c2d-9384-4462f1ccf9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:06.878691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbafb6a-7009-4c2d-9384-4462f1ccf9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:06.878880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:06.891012 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbafb6a-7009-4c2d-9384-4462f1ccf9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:06.894013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbafb6a-7009-4c2d-9384-4462f1ccf9c6 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:06.907662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 775/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:07.186893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9329fd70cea46c0b1c6a6235daf6d4c', 'request_id': 'req-1d731c88-9571-4de1-bd67-fe27bb2d02b0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.195927 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9329fd70cea46c0b1c6a6235daf6d4c', 'request_id': 'req-1d731c88-9571-4de1-bd67-fe27bb2d02b0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.204713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9329fd70cea46c0b1c6a6235daf6d4c', 'request_id': 'req-1d731c88-9571-4de1-bd67-fe27bb2d02b0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.236969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] The token cache is being invalidate because project c9329fd70cea46c0b1c6a6235daf6d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:07.236969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.240892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.254047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 753/1528] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:06 2022] DELETE /identity/v3/projects/c9329fd70cea46c0b1c6a6235daf6d4c => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:07.258177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbafb6a-7009-4c2d-9384-4462f1ccf9c6 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:07.278285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbafb6a-7009-4c2d-9384-4462f1ccf9c6 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:07.464630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:07.481712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:07.482004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:07.482284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] PATH_INFO: `/v3/users/e798c3ef341a4d2d9267c6bc9a7957a1` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:07.488774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e798c3ef341a4d2d9267c6bc9a7957a1)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:07.490786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:07.600062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e798c3ef341a4d2d9267c6bc9a7957a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.602237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e798c3ef341a4d2d9267c6bc9a7957a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.622149 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e798c3ef341a4d2d9267c6bc9a7957a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.651611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e798c3ef341a4d2d9267c6bc9a7957a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.654813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e798c3ef341a4d2d9267c6bc9a7957a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:07.687159 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 776/1529] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:07 2022] DELETE /identity/v3/users/e798c3ef341a4d2d9267c6bc9a7957a1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:07.913433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:07.916004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:07.930694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d731c88-9571-4de1-bd67-fe27bb2d02b0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.000399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.001095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.001261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.001534 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] PATH_INFO: `/v3/projects/4866ae5cd5f24de3a4b89d5146f57ac5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.002886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4866ae5cd5f24de3a4b89d5146f57ac5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.005477 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.057053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:08.069807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4866ae5cd5f24de3a4b89d5146f57ac5', 'request_id': 'req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.076594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4866ae5cd5f24de3a4b89d5146f57ac5', 'request_id': 'req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.082881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4866ae5cd5f24de3a4b89d5146f57ac5', 'request_id': 'req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.098474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] The token cache is being invalidate because project 4866ae5cd5f24de3a4b89d5146f57ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:08.099079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.099768 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.101587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 754/1530] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:07 2022] DELETE /identity/v3/projects/4866ae5cd5f24de3a4b89d5146f57ac5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:08.105673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:08.107269 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:08.119407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:08.121084 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:08.121927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7939e-7081-4467-b37f-5645eac566bd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.142887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:08.199824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.200769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.201113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.201444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] PATH_INFO: `/v3/users/11fabfa958e4444eb446a18565a7a0c8` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.201905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9cc73-5ca6-4eba-9ca2-eef0879bf27c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.203021 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11fabfa958e4444eb446a18565a7a0c8)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.205125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.207646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.208366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.209781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.210364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] PATH_INFO: `/v3/projects/dca4871dbc084813b43ee85313970a2d` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.211713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca4871dbc084813b43ee85313970a2d)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.213726 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.270158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11fabfa958e4444eb446a18565a7a0c8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.270876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11fabfa958e4444eb446a18565a7a0c8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.278800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11fabfa958e4444eb446a18565a7a0c8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.285257 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca4871dbc084813b43ee85313970a2d', 'request_id': 'req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.291762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11fabfa958e4444eb446a18565a7a0c8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.292295 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca4871dbc084813b43ee85313970a2d', 'request_id': 'req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.292715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f81d6aec-d30a-4d59-83ba-8eb60c0ec9c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11fabfa958e4444eb446a18565a7a0c8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.299298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca4871dbc084813b43ee85313970a2d', 'request_id': 'req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.311010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 777/1531] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:08 2022] DELETE /identity/v3/users/11fabfa958e4444eb446a18565a7a0c8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:08.319751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] The token cache is being invalidate because project dca4871dbc084813b43ee85313970a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:08.320050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.320725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d33aa87b-fdb5-41d3-b06a-a0389a04df3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.322460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 755/1532] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:08 2022] DELETE /identity/v3/projects/dca4871dbc084813b43ee85313970a2d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:08.327570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc8e2f-0375-4665-8794-b86c71b7e0c3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.327856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc8e2f-0375-4665-8794-b86c71b7e0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.328314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc8e2f-0375-4665-8794-b86c71b7e0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.350804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-dafc8e2f-0375-4665-8794-b86c71b7e0c3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:08.352082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-dafc8e2f-0375-4665-8794-b86c71b7e0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:08.432279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 778/1533] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:08.440497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf79ce-b6aa-42a9-b55a-35357f605815 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.440826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf79ce-b6aa-42a9-b55a-35357f605815 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.441097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf79ce-b6aa-42a9-b55a-35357f605815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.462120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bdaf79ce-b6aa-42a9-b55a-35357f605815 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:08.468268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bdaf79ce-b6aa-42a9-b55a-35357f605815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:08.477201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 756/1534] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:08.481297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc8e2f-0375-4665-8794-b86c71b7e0c3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:08.491111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc8e2f-0375-4665-8794-b86c71b7e0c3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.495678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f7f05-7715-4608-ab02-9e6577e0cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.496285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f7f05-7715-4608-ab02-9e6577e0cd67 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.496560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f7f05-7715-4608-ab02-9e6577e0cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.496902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f7f05-7715-4608-ab02-9e6577e0cd67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.497513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f7f05-7715-4608-ab02-9e6577e0cd67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:08.497857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f7f05-7715-4608-ab02-9e6577e0cd67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.499570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f7f05-7715-4608-ab02-9e6577e0cd67 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.515564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 779/1535] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:08.521136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf79ce-b6aa-42a9-b55a-35357f605815 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:08.535443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf79ce-b6aa-42a9-b55a-35357f605815 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.541125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42e6ec-22d8-45b2-99e4-284cd41e968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.541787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e6ec-22d8-45b2-99e4-284cd41e968d admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.542202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e6ec-22d8-45b2-99e4-284cd41e968d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.542478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e6ec-22d8-45b2-99e4-284cd41e968d admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.543220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42e6ec-22d8-45b2-99e4-284cd41e968d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.545540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42e6ec-22d8-45b2-99e4-284cd41e968d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.588974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 757/1536] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:08 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:08.590496 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f7f05-7715-4608-ab02-9e6577e0cd67 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:08.600557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f7f05-7715-4608-ab02-9e6577e0cd67 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.632834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:08.671997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42e6ec-22d8-45b2-99e4-284cd41e968d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:08.673993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1f42e6ec-22d8-45b2-99e4-284cd41e968d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:08.678960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590ddf-e321-4a7f-a590-72571d2b5e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.679529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590ddf-e321-4a7f-a590-72571d2b5e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.679810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590ddf-e321-4a7f-a590-72571d2b5e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.680083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590ddf-e321-4a7f-a590-72571d2b5e78 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.680724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590ddf-e321-4a7f-a590-72571d2b5e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.683678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590ddf-e321-4a7f-a590-72571d2b5e78 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.687463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42e6ec-22d8-45b2-99e4-284cd41e968d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.692467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.693179 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.693538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.693986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] PATH_INFO: `/v3/projects/a2f23327aed14dd8a9e1a599f6047ebd` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.695083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f23327aed14dd8a9e1a599f6047ebd)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.697105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.722015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 780/1537] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:08 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:08.723054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:08.723535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590ddf-e321-4a7f-a590-72571d2b5e78 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:08.736485 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590ddf-e321-4a7f-a590-72571d2b5e78 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.741312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb556-9f72-4b80-92e0-3b7753c4054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.742062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb556-9f72-4b80-92e0-3b7753c4054b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.742620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb556-9f72-4b80-92e0-3b7753c4054b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.742896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb556-9f72-4b80-92e0-3b7753c4054b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.743586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfb556-9f72-4b80-92e0-3b7753c4054b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.745330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfb556-9f72-4b80-92e0-3b7753c4054b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.756879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f23327aed14dd8a9e1a599f6047ebd', 'request_id': 'req-4cd878c1-673f-43f7-a571-f9e36d4bc36d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.757059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 781/1538] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:08.761028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb556-9f72-4b80-92e0-3b7753c4054b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:08.766566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f23327aed14dd8a9e1a599f6047ebd', 'request_id': 'req-4cd878c1-673f-43f7-a571-f9e36d4bc36d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.773398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f23327aed14dd8a9e1a599f6047ebd', 'request_id': 'req-4cd878c1-673f-43f7-a571-f9e36d4bc36d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.774344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb556-9f72-4b80-92e0-3b7753c4054b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.801327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] The token cache is being invalidate because project a2f23327aed14dd8a9e1a599f6047ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:08.801629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.802685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4cd878c1-673f-43f7-a571-f9e36d4bc36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:08.804750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 758/1539] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:08 2022] DELETE /identity/v3/projects/a2f23327aed14dd8a9e1a599f6047ebd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:08.810560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cd05e-cb9d-47a2-ab1b-060f331f0eac None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.810560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cd05e-cb9d-47a2-ab1b-060f331f0eac None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.810560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cd05e-cb9d-47a2-ab1b-060f331f0eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.831278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3d4cd05e-cb9d-47a2-ab1b-060f331f0eac None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:08.832677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3d4cd05e-cb9d-47a2-ab1b-060f331f0eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:08.840442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c4bc7-2181-4527-ab76-fe4503e05ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.840960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c4bc7-2181-4527-ab76-fe4503e05ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.841332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c4bc7-2181-4527-ab76-fe4503e05ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.841607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c4bc7-2181-4527-ab76-fe4503e05ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.842428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c4bc7-2181-4527-ab76-fe4503e05ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.845108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c4bc7-2181-4527-ab76-fe4503e05ba8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.858967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 782/1540] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:08.861412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c4bc7-2181-4527-ab76-fe4503e05ba8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:08.863648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-985c4bc7-2181-4527-ab76-fe4503e05ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:08.880514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c4bc7-2181-4527-ab76-fe4503e05ba8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:08.885923 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d5831-6d0b-454e-b73c-9c9b7dc0b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:08.886743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d5831-6d0b-454e-b73c-9c9b7dc0b58f admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.887396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d5831-6d0b-454e-b73c-9c9b7dc0b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.887667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d5831-6d0b-454e-b73c-9c9b7dc0b58f admin admin] PATH_INFO: `/v3/projects/445ddf28dabe47539e7cc5b74d5353a7/users/f876e144a9394ee79d5b81ff08af7922/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.905521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d5831-6d0b-454e-b73c-9c9b7dc0b58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=445ddf28dabe47539e7cc5b74d5353a7, user_id=f876e144a9394ee79d5b81ff08af7922, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:08.908402 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d5831-6d0b-454e-b73c-9c9b7dc0b58f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:08.916772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 759/1541] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:08.918371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd345f4-bfc2-4e01-a69f-5cf010a6f2da None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.918638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd345f4-bfc2-4e01-a69f-5cf010a6f2da None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.919170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd345f4-bfc2-4e01-a69f-5cf010a6f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:08.941879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 783/1542] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:08 2022] PUT /identity/v3/projects/445ddf28dabe47539e7cc5b74d5353a7/users/f876e144a9394ee79d5b81ff08af7922/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:08.946465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1bd345f4-bfc2-4e01-a69f-5cf010a6f2da None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:08.948366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1bd345f4-bfc2-4e01-a69f-5cf010a6f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:08.957291 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c76e-dada-40a4-acf5-cfec84550e44 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:08.959210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c76e-dada-40a4-acf5-cfec84550e44 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:08.959809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c76e-dada-40a4-acf5-cfec84550e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.026760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6580c76e-dada-40a4-acf5-cfec84550e44 None None] MFA Rules not processed for user `f876e144a9394ee79d5b81ff08af7922`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:09.028325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6580c76e-dada-40a4-acf5-cfec84550e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:09.050595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 760/1543] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:09.055202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd345f4-bfc2-4e01-a69f-5cf010a6f2da None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:09.066316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd345f4-bfc2-4e01-a69f-5cf010a6f2da None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:09.079273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22765bba-b1e9-4f84-9e15-d3685244a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:09.080043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22765bba-b1e9-4f84-9e15-d3685244a069 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.080314 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22765bba-b1e9-4f84-9e15-d3685244a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.080626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22765bba-b1e9-4f84-9e15-d3685244a069 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.081330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22765bba-b1e9-4f84-9e15-d3685244a069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:09.081537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22765bba-b1e9-4f84-9e15-d3685244a069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:09.083498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22765bba-b1e9-4f84-9e15-d3685244a069 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:09.100607 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 761/1544] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:09.102148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22765bba-b1e9-4f84-9e15-d3685244a069 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:09.114896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22765bba-b1e9-4f84-9e15-d3685244a069 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:09.122524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c19fb-d41a-4a12-a098-ae701dcd531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:09.123596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c19fb-d41a-4a12-a098-ae701dcd531e admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.124334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c19fb-d41a-4a12-a098-ae701dcd531e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.124635 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c19fb-d41a-4a12-a098-ae701dcd531e admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.125404 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c19fb-d41a-4a12-a098-ae701dcd531e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:09.127443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c19fb-d41a-4a12-a098-ae701dcd531e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:09.148393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 784/1545] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:09.163981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c76e-dada-40a4-acf5-cfec84550e44 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:09.166611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6580c76e-dada-40a4-acf5-cfec84550e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:09.166746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 762/1546] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:09 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:09.171786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c19fb-d41a-4a12-a098-ae701dcd531e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:09.183353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:09.194300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:09.250630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c19fb-d41a-4a12-a098-ae701dcd531e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:09.255604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764091e-c9a5-405c-846b-4f3fc0ece818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:09.256225 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764091e-c9a5-405c-846b-4f3fc0ece818 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.256504 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764091e-c9a5-405c-846b-4f3fc0ece818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.256774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764091e-c9a5-405c-846b-4f3fc0ece818 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.257412 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764091e-c9a5-405c-846b-4f3fc0ece818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:09.259375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764091e-c9a5-405c-846b-4f3fc0ece818 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:09.280571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c76e-dada-40a4-acf5-cfec84550e44 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:09.287430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 763/1547] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:09 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:09.292043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764091e-c9a5-405c-846b-4f3fc0ece818 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:09.306811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764091e-c9a5-405c-846b-4f3fc0ece818 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:09.313510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125d38-0a4a-4580-949b-141899b1f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:09.314764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125d38-0a4a-4580-949b-141899b1f9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.315160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125d38-0a4a-4580-949b-141899b1f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.315755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125d38-0a4a-4580-949b-141899b1f9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.316499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125d38-0a4a-4580-949b-141899b1f9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:09.319555 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125d38-0a4a-4580-949b-141899b1f9ee admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:09.332520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 764/1548] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:09.336312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f642-e719-446d-97dc-b3ab176e16f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8ec9210f54c6698477d7dbbe46a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:09.336537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125d38-0a4a-4580-949b-141899b1f9ee admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:09.336924 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f642-e719-446d-97dc-b3ab176e16f1 service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.337301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f642-e719-446d-97dc-b3ab176e16f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.337663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f642-e719-446d-97dc-b3ab176e16f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.347725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125d38-0a4a-4580-949b-141899b1f9ee admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:09.352932 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768884bf-235b-4967-831f-09bb28a800d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:09.353530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768884bf-235b-4967-831f-09bb28a800d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.353804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768884bf-235b-4967-831f-09bb28a800d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.354070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768884bf-235b-4967-831f-09bb28a800d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.354729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768884bf-235b-4967-831f-09bb28a800d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:09.356353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768884bf-235b-4967-831f-09bb28a800d4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:09.367916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 765/1549] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:09.371736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768884bf-235b-4967-831f-09bb28a800d4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:09.396331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768884bf-235b-4967-831f-09bb28a800d4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:09.402596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa5968-4a43-47f9-a1c4-5c003a3fd3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:09.403557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa5968-4a43-47f9-a1c4-5c003a3fd3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.404005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa5968-4a43-47f9-a1c4-5c003a3fd3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.404345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa5968-4a43-47f9-a1c4-5c003a3fd3e9 admin admin] PATH_INFO: `/v3/projects/b09fc6c4d07a45778e7a3557163f67ba/users/85bbf36531a445758a8e644d49881045/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.411708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f642-e719-446d-97dc-b3ab176e16f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:09.413251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f642-e719-446d-97dc-b3ab176e16f1 service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:09.419706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa5968-4a43-47f9-a1c4-5c003a3fd3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09fc6c4d07a45778e7a3557163f67ba, user_id=85bbf36531a445758a8e644d49881045, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:09.422368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa5968-4a43-47f9-a1c4-5c003a3fd3e9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:09.423557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 785/1550] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:09.440727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 766/1551] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:09 2022] PUT /identity/v3/projects/b09fc6c4d07a45778e7a3557163f67ba/users/85bbf36531a445758a8e644d49881045/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:09.452440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6dc3-1206-488a-aefc-179402917ff5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.452820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6dc3-1206-488a-aefc-179402917ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.453150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6dc3-1206-488a-aefc-179402917ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.488098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-045d6dc3-1206-488a-aefc-179402917ff5 None None] MFA Rules not processed for user `85bbf36531a445758a8e644d49881045`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:09.489480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-045d6dc3-1206-488a-aefc-179402917ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:09.550016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:09.571119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 786/1552] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:09.575978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa5968-4a43-47f9-a1c4-5c003a3fd3e9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:09.690678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa5968-4a43-47f9-a1c4-5c003a3fd3e9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:09.695933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c550ce-1933-4dec-859d-507cf263e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:09.696833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c550ce-1933-4dec-859d-507cf263e530 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.697141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c550ce-1933-4dec-859d-507cf263e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.697356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c550ce-1933-4dec-859d-507cf263e530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.698002 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c550ce-1933-4dec-859d-507cf263e530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:09.700993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c550ce-1933-4dec-859d-507cf263e530 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:09.747221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d6dc3-1206-488a-aefc-179402917ff5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:09.747634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 767/1553] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:09 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:09.759818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d6dc3-1206-488a-aefc-179402917ff5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:09.980210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e5a0a-4179-478f-99d6-30543b9607c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:09.981173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e5a0a-4179-478f-99d6-30543b9607c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:09.981747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e5a0a-4179-478f-99d6-30543b9607c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:09.982250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e5a0a-4179-478f-99d6-30543b9607c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:09.983254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e5a0a-4179-478f-99d6-30543b9607c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:09.985629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e5a0a-4179-478f-99d6-30543b9607c0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:10.052847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c550ce-1933-4dec-859d-507cf263e530 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:10.055776 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-69c550ce-1933-4dec-859d-507cf263e530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:10.061540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 787/1554] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:09 2022] POST /identity/v3/users => generated 296 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:10.066180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e5a0a-4179-478f-99d6-30543b9607c0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:10.091881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e5a0a-4179-478f-99d6-30543b9607c0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:10.097679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c550ce-1933-4dec-859d-507cf263e530 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:10.098651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be222d-3176-4165-80f9-eff4e4efdf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:10.099401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be222d-3176-4165-80f9-eff4e4efdf6d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:10.099916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be222d-3176-4165-80f9-eff4e4efdf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:10.100263 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be222d-3176-4165-80f9-eff4e4efdf6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:10.101082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be222d-3176-4165-80f9-eff4e4efdf6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:10.104685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be222d-3176-4165-80f9-eff4e4efdf6d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:10.116051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:10.116735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:10.117016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:10.117338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] PATH_INFO: `/v3/users/25d3316977244c358ca2e02f72706ee4` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:10.122828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 788/1555] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:10.126289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be222d-3176-4165-80f9-eff4e4efdf6d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:10.127633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d3316977244c358ca2e02f72706ee4)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:10.129970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:10.152246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be222d-3176-4165-80f9-eff4e4efdf6d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:10.172991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e949-0748-40b9-baba-7f0ba20e23b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:10.173725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e949-0748-40b9-baba-7f0ba20e23b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:10.174144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e949-0748-40b9-baba-7f0ba20e23b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:10.174429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e949-0748-40b9-baba-7f0ba20e23b6 admin admin] PATH_INFO: `/v3/projects/5b99e2f0c76e4b139a71bee608dec870/users/832c29a41d6f490da25b077bfa5a1f72/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:10.203766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95e949-0748-40b9-baba-7f0ba20e23b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b99e2f0c76e4b139a71bee608dec870, user_id=832c29a41d6f490da25b077bfa5a1f72, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:10.204588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:10.212547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d3316977244c358ca2e02f72706ee4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:10.212716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95e949-0748-40b9-baba-7f0ba20e23b6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:10.213326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d3316977244c358ca2e02f72706ee4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:10.231354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d3316977244c358ca2e02f72706ee4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:10.239369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 789/1556] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:10 2022] PUT /identity/v3/projects/5b99e2f0c76e4b139a71bee608dec870/users/832c29a41d6f490da25b077bfa5a1f72/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:10.240774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e949-0748-40b9-baba-7f0ba20e23b6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:10.243215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3d95e949-0748-40b9-baba-7f0ba20e23b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:10.253831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d3316977244c358ca2e02f72706ee4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:10.254762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-402be4c1-cc7b-4a34-b61d-e2a02a8e6f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d3316977244c358ca2e02f72706ee4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:10.278869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 768/1557] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:10 2022] DELETE /identity/v3/users/25d3316977244c358ca2e02f72706ee4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:10.285876 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb75e11-ac99-4621-9d2c-5b5615ec04ed None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:10.286664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb75e11-ac99-4621-9d2c-5b5615ec04ed None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:10.286763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb75e11-ac99-4621-9d2c-5b5615ec04ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:10.311924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0fb75e11-ac99-4621-9d2c-5b5615ec04ed None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:10.313882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0fb75e11-ac99-4621-9d2c-5b5615ec04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:10.391834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e949-0748-40b9-baba-7f0ba20e23b6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:10.398080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 769/1558] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:10.400465 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb03074-93c0-49ef-b348-836fe2bb41ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:10.401130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03074-93c0-49ef-b348-836fe2bb41ce admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:10.401392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03074-93c0-49ef-b348-836fe2bb41ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:10.401948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03074-93c0-49ef-b348-836fe2bb41ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:10.402441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb03074-93c0-49ef-b348-836fe2bb41ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:10.404413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb03074-93c0-49ef-b348-836fe2bb41ce admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:10.413914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb75e11-ac99-4621-9d2c-5b5615ec04ed None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:10.415875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 790/1559] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:10.417216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0fb75e11-ac99-4621-9d2c-5b5615ec04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:10.419969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb03074-93c0-49ef-b348-836fe2bb41ce admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:10.430797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb03074-93c0-49ef-b348-836fe2bb41ce admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:10.451154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995f75d-b100-4abe-ae84-cb0a1cf6ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:10.451154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995f75d-b100-4abe-ae84-cb0a1cf6ab39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:10.451154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995f75d-b100-4abe-ae84-cb0a1cf6ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:10.451154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995f75d-b100-4abe-ae84-cb0a1cf6ab39 admin admin] PATH_INFO: `/v3/projects/5b99e2f0c76e4b139a71bee608dec870/users/832c29a41d6f490da25b077bfa5a1f72/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:10.451966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995f75d-b100-4abe-ae84-cb0a1cf6ab39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b99e2f0c76e4b139a71bee608dec870, user_id=832c29a41d6f490da25b077bfa5a1f72, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:10.451966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995f75d-b100-4abe-ae84-cb0a1cf6ab39 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:10.471685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 791/1560] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:10 2022] PUT /identity/v3/projects/5b99e2f0c76e4b139a71bee608dec870/users/832c29a41d6f490da25b077bfa5a1f72/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:10.482273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49e55-a996-4682-9d9d-a98bd3a6a930 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:10.482958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49e55-a996-4682-9d9d-a98bd3a6a930 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:10.483231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49e55-a996-4682-9d9d-a98bd3a6a930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:10.521282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb75e11-ac99-4621-9d2c-5b5615ec04ed None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:10.533582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a8b49e55-a996-4682-9d9d-a98bd3a6a930 None None] MFA Rules not processed for user `832c29a41d6f490da25b077bfa5a1f72`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:10.536091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a8b49e55-a996-4682-9d9d-a98bd3a6a930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:10.564986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:10.593129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6fb27-f8cb-483c-ab3e-c2c30eb014d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:10.593966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6fb27-f8cb-483c-ab3e-c2c30eb014d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:10.594177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6fb27-f8cb-483c-ab3e-c2c30eb014d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:10.594624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6fb27-f8cb-483c-ab3e-c2c30eb014d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:10.631416 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:10.651172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 792/1561] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:10.665807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49e55-a996-4682-9d9d-a98bd3a6a930 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:10.667737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a8b49e55-a996-4682-9d9d-a98bd3a6a930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:10.683682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6fb27-f8cb-483c-ab3e-c2c30eb014d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:10.685352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6fb27-f8cb-483c-ab3e-c2c30eb014d2 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:10.697318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 770/1562] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:10.740359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49e55-a996-4682-9d9d-a98bd3a6a930 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:10.744144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab813-e3f4-4240-944a-facb440e714e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:10.744767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab813-e3f4-4240-944a-facb440e714e service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:10.745064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab813-e3f4-4240-944a-facb440e714e service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:10.745326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab813-e3f4-4240-944a-facb440e714e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:10.757097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ab813-e3f4-4240-944a-facb440e714e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:10.759179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ab813-e3f4-4240-944a-facb440e714e service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:10.771084 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 793/1563] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:11.144652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6fb27-f8cb-483c-ab3e-c2c30eb014d2 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:11.147083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b7f6fb27-f8cb-483c-ab3e-c2c30eb014d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:11.199813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6fb27-f8cb-483c-ab3e-c2c30eb014d2 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:11.209594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:11.211363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:11.211815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:11.212214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] PATH_INFO: `/v3/projects/151a2ca0db7e46deb3bd074a6a71911f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:11.213990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=151a2ca0db7e46deb3bd074a6a71911f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:11.218267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:11.346440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab813-e3f4-4240-944a-facb440e714e service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:11.356103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151a2ca0db7e46deb3bd074a6a71911f', 'request_id': 'req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.365504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab813-e3f4-4240-944a-facb440e714e service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:11.371138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151a2ca0db7e46deb3bd074a6a71911f', 'request_id': 'req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.378550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151a2ca0db7e46deb3bd074a6a71911f', 'request_id': 'req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.401533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] The token cache is being invalidate because project 151a2ca0db7e46deb3bd074a6a71911f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:11.401824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.402475 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.404207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 771/1564] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:11 2022] DELETE /identity/v3/projects/151a2ca0db7e46deb3bd074a6a71911f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:11.407826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:11.409336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:11.484832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832c29a41d6f490da25b077bfa5a1f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b99e2f0c76e4b139a71bee608dec870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:11.485608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:11.485977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:11.486346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:11.487172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:11.487727 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:11.490074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:11.506244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6e6ce-5de4-46d3-a47d-a85a1d96a51a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:11.509076 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 794/1565] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:11.513952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:11.514848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:11.515888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:11.516177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:11.516437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] PATH_INFO: `/v3/users/608d636d316f4d1385f4a992858afde4` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:11.518022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:11.523822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=608d636d316f4d1385f4a992858afde4)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:11.526481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:11.531016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99f0e8-ed9f-435d-8853-4f466e2a1277 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:11.536082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f3d01-5052-4b0a-ab0a-66f4722794fa tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832c29a41d6f490da25b077bfa5a1f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b99e2f0c76e4b139a71bee608dec870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:11.536702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f3d01-5052-4b0a-ab0a-66f4722794fa tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:11.537148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f3d01-5052-4b0a-ab0a-66f4722794fa tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:11.537412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f3d01-5052-4b0a-ab0a-66f4722794fa tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:11.538590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f3d01-5052-4b0a-ab0a-66f4722794fa tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:11.540126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f3d01-5052-4b0a-ab0a-66f4722794fa tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:11.583799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 795/1566] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:11 2022] POST /identity/v3/projects => generated 355 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:11.586882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f3d01-5052-4b0a-ab0a-66f4722794fa tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:11.601270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608d636d316f4d1385f4a992858afde4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.601977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608d636d316f4d1385f4a992858afde4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.604433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:11.614964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608d636d316f4d1385f4a992858afde4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.649246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608d636d316f4d1385f4a992858afde4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.650559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608d636d316f4d1385f4a992858afde4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.655386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:11.670266 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 772/1567] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:11 2022] DELETE /identity/v3/users/608d636d316f4d1385f4a992858afde4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:11.709272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f3d01-5052-4b0a-ab0a-66f4722794fa tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:11.801616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832c29a41d6f490da25b077bfa5a1f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b99e2f0c76e4b139a71bee608dec870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:11.802244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:11.802536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:11.802792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:11.803708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:11.803834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:11.805440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:11.818754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 796/1568] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:11.880652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:11.882219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:11.898172 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5820-b9f4-48a3-997a-e6c2478259bb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:11.903653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832c29a41d6f490da25b077bfa5a1f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b99e2f0c76e4b139a71bee608dec870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:11.904615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:11.904727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:11.904967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] PATH_INFO: `/v3/projects/271df400972b4d6184dde50033c1f9fb` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:11.906114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Authorizing `identity:delete_project(project_id=271df400972b4d6184dde50033c1f9fb)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:11.908070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:11.987286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271df400972b4d6184dde50033c1f9fb', 'request_id': 'req-acb66428-9606-469e-a22b-63a8dc593765'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:11.994894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271df400972b4d6184dde50033c1f9fb', 'request_id': 'req-acb66428-9606-469e-a22b-63a8dc593765'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.016640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271df400972b4d6184dde50033c1f9fb', 'request_id': 'req-acb66428-9606-469e-a22b-63a8dc593765'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.036430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] The token cache is being invalidate because project 271df400972b4d6184dde50033c1f9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:12.036980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.037647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.039612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 773/1569] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:11 2022] DELETE /identity/v3/projects/271df400972b4d6184dde50033c1f9fb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:12.241999 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:12.244661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:12.347907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1ba0b-2989-48c2-9c45-9d5c8b4a44a1 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:12.414764 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:12.418047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:12.435141 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:12.436098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:12.436261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:12.436537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] PATH_INFO: `/v3/projects/94c7ccaade4d46929b67490a94b1fd0c` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:12.437695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c7ccaade4d46929b67490a94b1fd0c)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:12.439798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:12.468292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:12.509607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c7ccaade4d46929b67490a94b1fd0c', 'request_id': 'req-6c5affd8-daa1-474e-a019-dcc324b0bafc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.519192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c7ccaade4d46929b67490a94b1fd0c', 'request_id': 'req-6c5affd8-daa1-474e-a019-dcc324b0bafc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.532219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c7ccaade4d46929b67490a94b1fd0c', 'request_id': 'req-6c5affd8-daa1-474e-a019-dcc324b0bafc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.539287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb66428-9606-469e-a22b-63a8dc593765 tempest-VolumeQuotaClassesTest-528927192 tempest-VolumeQuotaClassesTest-528927192-project-admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:12.549563 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] The token cache is being invalidate because project 94c7ccaade4d46929b67490a94b1fd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:12.549897 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.552683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6c5affd8-daa1-474e-a019-dcc324b0bafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.564677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 797/1570] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:12 2022] DELETE /identity/v3/projects/94c7ccaade4d46929b67490a94b1fd0c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:12.580922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aabe8d-197f-477e-8911-7407c621e835 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:12.581266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aabe8d-197f-477e-8911-7407c621e835 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:12.584264 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aabe8d-197f-477e-8911-7407c621e835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:12.612556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-49aabe8d-197f-477e-8911-7407c621e835 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:12.613984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-49aabe8d-197f-477e-8911-7407c621e835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:12.620724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:12.624805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:12.626649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:12.627162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:12.627762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] PATH_INFO: `/v3/users/85bbf36531a445758a8e644d49881045` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:12.630312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85bbf36531a445758a8e644d49881045)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:12.632589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:12.691542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 798/1571] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:12.699930 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078ca67-f443-4548-9560-d076e8191af3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:12.700410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078ca67-f443-4548-9560-d076e8191af3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:12.700834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078ca67-f443-4548-9560-d076e8191af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:12.705801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85bbf36531a445758a8e644d49881045'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.706628 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85bbf36531a445758a8e644d49881045'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.716181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85bbf36531a445758a8e644d49881045'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.744525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6078ca67-f443-4548-9560-d076e8191af3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:12.747297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6078ca67-f443-4548-9560-d076e8191af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:12.749216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85bbf36531a445758a8e644d49881045'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.750732 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6f5b841-2e3e-4afb-98b7-e7c8923d92a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85bbf36531a445758a8e644d49881045'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:12.769203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 799/1572] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:12.770630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078ca67-f443-4548-9560-d076e8191af3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:12.774888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 774/1573] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:12 2022] DELETE /identity/v3/users/85bbf36531a445758a8e644d49881045 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:12.777192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260534c-dac5-406d-a4fe-2fffd4695268 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:12.777478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260534c-dac5-406d-a4fe-2fffd4695268 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:12.777862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260534c-dac5-406d-a4fe-2fffd4695268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:12.787769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078ca67-f443-4548-9560-d076e8191af3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:12.805383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2260534c-dac5-406d-a4fe-2fffd4695268 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:12.806614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2260534c-dac5-406d-a4fe-2fffd4695268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:12.883173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766a736-807f-4ea7-96ef-77d0d7147d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:12.883173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766a736-807f-4ea7-96ef-77d0d7147d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:12.883173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766a736-807f-4ea7-96ef-77d0d7147d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:12.883173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766a736-807f-4ea7-96ef-77d0d7147d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:12.883494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766a736-807f-4ea7-96ef-77d0d7147d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:12.883494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766a736-807f-4ea7-96ef-77d0d7147d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:12.884646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766a736-807f-4ea7-96ef-77d0d7147d5c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:12.902912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 800/1574] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:43:12.908152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766a736-807f-4ea7-96ef-77d0d7147d5c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:12.923562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766a736-807f-4ea7-96ef-77d0d7147d5c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:12.924910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 775/1575] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:12.929222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82afc0-f1fb-4d0a-ba8e-8aefb9bff3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:12.929841 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82afc0-f1fb-4d0a-ba8e-8aefb9bff3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:12.930124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82afc0-f1fb-4d0a-ba8e-8aefb9bff3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:12.930394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82afc0-f1fb-4d0a-ba8e-8aefb9bff3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:12.931382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82afc0-f1fb-4d0a-ba8e-8aefb9bff3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:12.932979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82afc0-f1fb-4d0a-ba8e-8aefb9bff3f4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:12.941439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260534c-dac5-406d-a4fe-2fffd4695268 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:12.956047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2260534c-dac5-406d-a4fe-2fffd4695268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:12.979041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 801/1576] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:12 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:12.980167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82afc0-f1fb-4d0a-ba8e-8aefb9bff3f4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:12.993654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:13.048421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260534c-dac5-406d-a4fe-2fffd4695268 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.058797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82afc0-f1fb-4d0a-ba8e-8aefb9bff3f4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.073743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874be155-5beb-4471-90a0-c67dde535628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.074401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874be155-5beb-4471-90a0-c67dde535628 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.074680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874be155-5beb-4471-90a0-c67dde535628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.075025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874be155-5beb-4471-90a0-c67dde535628 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.075723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874be155-5beb-4471-90a0-c67dde535628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.077704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874be155-5beb-4471-90a0-c67dde535628 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.089011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:13.108317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 802/1577] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:12 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:13.109830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874be155-5beb-4471-90a0-c67dde535628 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.121302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874be155-5beb-4471-90a0-c67dde535628 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.126721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fd61f-0b1c-44e3-8d5d-7bdf83045d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.127624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fd61f-0b1c-44e3-8d5d-7bdf83045d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.127910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fd61f-0b1c-44e3-8d5d-7bdf83045d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.128183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fd61f-0b1c-44e3-8d5d-7bdf83045d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.128832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fd61f-0b1c-44e3-8d5d-7bdf83045d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.129023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff2c57-7b83-4612-919d-00a6add994f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.129829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff2c57-7b83-4612-919d-00a6add994f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.130242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff2c57-7b83-4612-919d-00a6add994f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.130453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fd61f-0b1c-44e3-8d5d-7bdf83045d75 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.130847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff2c57-7b83-4612-919d-00a6add994f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.142268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff2c57-7b83-4612-919d-00a6add994f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.143091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 803/1578] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:13.143751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff2c57-7b83-4612-919d-00a6add994f9 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.147355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fd61f-0b1c-44e3-8d5d-7bdf83045d75 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.155178 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 776/1579] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:13.159804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fd61f-0b1c-44e3-8d5d-7bdf83045d75 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.164643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c6b38-3669-4ded-b418-58e754ed5913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.165261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c6b38-3669-4ded-b418-58e754ed5913 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.165541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c6b38-3669-4ded-b418-58e754ed5913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.165811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c6b38-3669-4ded-b418-58e754ed5913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.166650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c6b38-3669-4ded-b418-58e754ed5913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.168305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c6b38-3669-4ded-b418-58e754ed5913 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.180422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 804/1580] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:13.184787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff2c57-7b83-4612-919d-00a6add994f9 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.197687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff2c57-7b83-4612-919d-00a6add994f9 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.204226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd61ce2-1de1-4bd7-a866-c69a60b4b394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.205003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd61ce2-1de1-4bd7-a866-c69a60b4b394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.206193 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd61ce2-1de1-4bd7-a866-c69a60b4b394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.206548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd61ce2-1de1-4bd7-a866-c69a60b4b394 admin admin] PATH_INFO: `/v3/projects/1a4f1f4ebdd142bcb5a2fe524c11cf32/users/d7bc661f09c6410585a138e647ce0ae6/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.230232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd61ce2-1de1-4bd7-a866-c69a60b4b394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4f1f4ebdd142bcb5a2fe524c11cf32, user_id=d7bc661f09c6410585a138e647ce0ae6, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.234780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd61ce2-1de1-4bd7-a866-c69a60b4b394 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.256359 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 777/1581] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:13 2022] PUT /identity/v3/projects/1a4f1f4ebdd142bcb5a2fe524c11cf32/users/d7bc661f09c6410585a138e647ce0ae6/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:13.267359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409daab-a137-48f9-854d-4cec496474bb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.268832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409daab-a137-48f9-854d-4cec496474bb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.268832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409daab-a137-48f9-854d-4cec496474bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.316663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e409daab-a137-48f9-854d-4cec496474bb None None] MFA Rules not processed for user `d7bc661f09c6410585a138e647ce0ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:13.318609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e409daab-a137-48f9-854d-4cec496474bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:13.451036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 805/1582] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:13.455205 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd61ce2-1de1-4bd7-a866-c69a60b4b394 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.480314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409daab-a137-48f9-854d-4cec496474bb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.481844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e409daab-a137-48f9-854d-4cec496474bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:13.548346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd61ce2-1de1-4bd7-a866-c69a60b4b394 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.557680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a86b3-d6de-4d15-b88d-486d3720926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.557680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a86b3-d6de-4d15-b88d-486d3720926c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.557680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a86b3-d6de-4d15-b88d-486d3720926c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.557680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a86b3-d6de-4d15-b88d-486d3720926c admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.558055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a86b3-d6de-4d15-b88d-486d3720926c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.560062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a86b3-d6de-4d15-b88d-486d3720926c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.576082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409daab-a137-48f9-854d-4cec496474bb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.582377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.583118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.583356 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.583668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] PATH_INFO: `/v3/projects/b09fc6c4d07a45778e7a3557163f67ba` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.585070 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09fc6c4d07a45778e7a3557163f67ba)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.587024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.591550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 778/1583] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:13 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:13.595398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a86b3-d6de-4d15-b88d-486d3720926c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.598915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:13.655945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09fc6c4d07a45778e7a3557163f67ba', 'request_id': 'req-481a5366-756a-4a65-be6a-fcf975181c43'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.663584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09fc6c4d07a45778e7a3557163f67ba', 'request_id': 'req-481a5366-756a-4a65-be6a-fcf975181c43'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.671517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09fc6c4d07a45778e7a3557163f67ba', 'request_id': 'req-481a5366-756a-4a65-be6a-fcf975181c43'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.688112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] The token cache is being invalidate because project b09fc6c4d07a45778e7a3557163f67ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:13.688439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.689057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.691298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 806/1584] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:13 2022] DELETE /identity/v3/projects/b09fc6c4d07a45778e7a3557163f67ba => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:13.692845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a86b3-d6de-4d15-b88d-486d3720926c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.694963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.698403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:13.745253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:13.786210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39845e87-940d-4bb0-aa36-7d94874a5040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.786453 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39845e87-940d-4bb0-aa36-7d94874a5040 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.786684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39845e87-940d-4bb0-aa36-7d94874a5040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.786909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39845e87-940d-4bb0-aa36-7d94874a5040 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.788008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39845e87-940d-4bb0-aa36-7d94874a5040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.789869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39845e87-940d-4bb0-aa36-7d94874a5040 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.803904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5366-756a-4a65-be6a-fcf975181c43 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.809750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.810343 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.810606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.810872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] PATH_INFO: `/v3/users/832c29a41d6f490da25b077bfa5a1f72` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.813063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] RBAC: Authorizing `identity:delete_user(user_id=832c29a41d6f490da25b077bfa5a1f72)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.815446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.823607 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 779/1585] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:13 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:13.825002 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39845e87-940d-4bb0-aa36-7d94874a5040 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.826969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-39845e87-940d-4bb0-aa36-7d94874a5040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:13.839399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39845e87-940d-4bb0-aa36-7d94874a5040 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.844613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaed5e-9a13-4ef5-a188-9a73dae4ed3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.845228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaed5e-9a13-4ef5-a188-9a73dae4ed3b admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.845508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaed5e-9a13-4ef5-a188-9a73dae4ed3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.845775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaed5e-9a13-4ef5-a188-9a73dae4ed3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.846422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaed5e-9a13-4ef5-a188-9a73dae4ed3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.848064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaed5e-9a13-4ef5-a188-9a73dae4ed3b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.862150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 780/1586] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:13.864701 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaed5e-9a13-4ef5-a188-9a73dae4ed3b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.877666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaed5e-9a13-4ef5-a188-9a73dae4ed3b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:13.887403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832c29a41d6f490da25b077bfa5a1f72'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.888409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832c29a41d6f490da25b077bfa5a1f72'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.893062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703c057-998d-4c74-b711-a63daa5a906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:13.895321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703c057-998d-4c74-b711-a63daa5a906a admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:13.895650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703c057-998d-4c74-b711-a63daa5a906a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:13.895930 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703c057-998d-4c74-b711-a63daa5a906a admin admin] PATH_INFO: `/v3/projects/6fea972c308f4e718746390e4a01bd52/users/cd75c0ed93f4466ca69de0c8d64381b6/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:13.915607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832c29a41d6f490da25b077bfa5a1f72'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.917578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703c057-998d-4c74-b711-a63daa5a906a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fea972c308f4e718746390e4a01bd52, user_id=cd75c0ed93f4466ca69de0c8d64381b6, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:13.925098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703c057-998d-4c74-b711-a63daa5a906a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:13.941360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832c29a41d6f490da25b077bfa5a1f72'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.942396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832c29a41d6f490da25b077bfa5a1f72'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:13.957688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 781/1587] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:13 2022] PUT /identity/v3/projects/6fea972c308f4e718746390e4a01bd52/users/cd75c0ed93f4466ca69de0c8d64381b6/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:13.962849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703c057-998d-4c74-b711-a63daa5a906a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:13.965375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6703c057-998d-4c74-b711-a63daa5a906a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:13.981344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 807/1588] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:13 2022] DELETE /identity/v3/users/832c29a41d6f490da25b077bfa5a1f72 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:14.110525 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703c057-998d-4c74-b711-a63daa5a906a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:14.211344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb536c6-a4e5-44b9-9648-b1aa8d17b114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:14.212185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb536c6-a4e5-44b9-9648-b1aa8d17b114 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.212592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb536c6-a4e5-44b9-9648-b1aa8d17b114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.212954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb536c6-a4e5-44b9-9648-b1aa8d17b114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.213741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb536c6-a4e5-44b9-9648-b1aa8d17b114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:14.216243 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb536c6-a4e5-44b9-9648-b1aa8d17b114 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:14.231610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 782/1589] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:14.235220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:14.255121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9a9c3-b4e0-4693-977c-7fcaa9c9aaab admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:14.260665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f46662-7259-4770-b219-0ea1ed25874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:14.261924 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f46662-7259-4770-b219-0ea1ed25874f admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.262272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f46662-7259-4770-b219-0ea1ed25874f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.262616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f46662-7259-4770-b219-0ea1ed25874f admin admin] PATH_INFO: `/v3/projects/6fea972c308f4e718746390e4a01bd52/users/cd75c0ed93f4466ca69de0c8d64381b6/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.264911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f46662-7259-4770-b219-0ea1ed25874f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fea972c308f4e718746390e4a01bd52, user_id=cd75c0ed93f4466ca69de0c8d64381b6, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:14.268377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f46662-7259-4770-b219-0ea1ed25874f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:14.305915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 808/1590] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:14 2022] PUT /identity/v3/projects/6fea972c308f4e718746390e4a01bd52/users/cd75c0ed93f4466ca69de0c8d64381b6/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:14.317252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6300a-79e7-42f7-ba28-f26151bf1b8f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.317526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6300a-79e7-42f7-ba28-f26151bf1b8f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.317804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6300a-79e7-42f7-ba28-f26151bf1b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.351667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f4b6300a-79e7-42f7-ba28-f26151bf1b8f None None] MFA Rules not processed for user `cd75c0ed93f4466ca69de0c8d64381b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:14.353134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f4b6300a-79e7-42f7-ba28-f26151bf1b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:14.387690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:14.465659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 783/1591] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:14.474476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f46662-7259-4770-b219-0ea1ed25874f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:14.476221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-26f46662-7259-4770-b219-0ea1ed25874f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:14.479390 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6300a-79e7-42f7-ba28-f26151bf1b8f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:14.480776 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f4b6300a-79e7-42f7-ba28-f26151bf1b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:14.485711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:14.584837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6300a-79e7-42f7-ba28-f26151bf1b8f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:14.589175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a76bd8-f57c-42b7-b910-a722a5e83551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:14.590063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a76bd8-f57c-42b7-b910-a722a5e83551 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.590315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a76bd8-f57c-42b7-b910-a722a5e83551 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.590569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a76bd8-f57c-42b7-b910-a722a5e83551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.593976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f46662-7259-4770-b219-0ea1ed25874f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:14.600918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:14.601198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a76bd8-f57c-42b7-b910-a722a5e83551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:14.601567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.602243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.602243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] PATH_INFO: `/v3/projects/5b99e2f0c76e4b139a71bee608dec870` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.602891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a76bd8-f57c-42b7-b910-a722a5e83551 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:14.603258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b99e2f0c76e4b139a71bee608dec870)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:14.605520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:14.616248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 784/1592] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:14.698042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b99e2f0c76e4b139a71bee608dec870', 'request_id': 'req-e8c498ff-db47-4907-9df1-0a4a399752c0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:14.705190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b99e2f0c76e4b139a71bee608dec870', 'request_id': 'req-e8c498ff-db47-4907-9df1-0a4a399752c0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:14.714636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b99e2f0c76e4b139a71bee608dec870', 'request_id': 'req-e8c498ff-db47-4907-9df1-0a4a399752c0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:14.722882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a76bd8-f57c-42b7-b910-a722a5e83551 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:14.728226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] The token cache is being invalidate because project 5b99e2f0c76e4b139a71bee608dec870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:14.728515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:14.729150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8c498ff-db47-4907-9df1-0a4a399752c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:14.730715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 809/1593] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:14 2022] DELETE /identity/v3/projects/5b99e2f0c76e4b139a71bee608dec870 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:14.733004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a76bd8-f57c-42b7-b910-a722a5e83551 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:14.735889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517f0f-b490-4171-9d0a-0e695d8b0b1c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.736193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517f0f-b490-4171-9d0a-0e695d8b0b1c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.736467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517f0f-b490-4171-9d0a-0e695d8b0b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.760331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0f517f0f-b490-4171-9d0a-0e695d8b0b1c None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:14.761746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0f517f0f-b490-4171-9d0a-0e695d8b0b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:14.789562 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96286830-82a8-4b26-8370-e311ba45cfc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:14.790168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96286830-82a8-4b26-8370-e311ba45cfc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.790442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96286830-82a8-4b26-8370-e311ba45cfc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.790707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96286830-82a8-4b26-8370-e311ba45cfc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.792442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96286830-82a8-4b26-8370-e311ba45cfc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:14.835110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 810/1594] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:14.842769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c031d6-c9b1-4ab1-b84a-609d144332b1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.843082 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c031d6-c9b1-4ab1-b84a-609d144332b1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.843348 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c031d6-c9b1-4ab1-b84a-609d144332b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.867853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96286830-82a8-4b26-8370-e311ba45cfc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:14.869294 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96286830-82a8-4b26-8370-e311ba45cfc6 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:14.876444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-57c031d6-c9b1-4ab1-b84a-609d144332b1 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:14.878248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-57c031d6-c9b1-4ab1-b84a-609d144332b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:14.884235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 785/1595] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:14.902028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 811/1596] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:14.907151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96286830-82a8-4b26-8370-e311ba45cfc6 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:14.921411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96286830-82a8-4b26-8370-e311ba45cfc6 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:14.926577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850762da-2b16-438e-b274-c029c31aeb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:14.927229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850762da-2b16-438e-b274-c029c31aeb63 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.927496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850762da-2b16-438e-b274-c029c31aeb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.927758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850762da-2b16-438e-b274-c029c31aeb63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.928686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850762da-2b16-438e-b274-c029c31aeb63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:14.928986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850762da-2b16-438e-b274-c029c31aeb63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:14.930577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850762da-2b16-438e-b274-c029c31aeb63 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:14.951363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 786/1597] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:14.955564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c031d6-c9b1-4ab1-b84a-609d144332b1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:14.966195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c031d6-c9b1-4ab1-b84a-609d144332b1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:14.973916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb30287-44ef-42a5-afe8-49d41c347065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:14.974601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb30287-44ef-42a5-afe8-49d41c347065 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:14.974874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb30287-44ef-42a5-afe8-49d41c347065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:14.975167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb30287-44ef-42a5-afe8-49d41c347065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:14.975854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb30287-44ef-42a5-afe8-49d41c347065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:14.977801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb30287-44ef-42a5-afe8-49d41c347065 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:15.011298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 812/1598] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:14 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:15.015454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850762da-2b16-438e-b274-c029c31aeb63 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:15.027842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850762da-2b16-438e-b274-c029c31aeb63 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:15.036110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:15.120744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47302c52-96f1-4cdd-8b87-0b6e0752e1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:15.121378 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302c52-96f1-4cdd-8b87-0b6e0752e1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.121657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302c52-96f1-4cdd-8b87-0b6e0752e1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.121932 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302c52-96f1-4cdd-8b87-0b6e0752e1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.122893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47302c52-96f1-4cdd-8b87-0b6e0752e1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:15.125080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47302c52-96f1-4cdd-8b87-0b6e0752e1e1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:15.151590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 787/1599] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:15 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:15.155663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb30287-44ef-42a5-afe8-49d41c347065 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:15.181761 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb30287-44ef-42a5-afe8-49d41c347065 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:15.187414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91b779-d6c9-4f3b-9530-e2396f103c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:15.188177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91b779-d6c9-4f3b-9530-e2396f103c3a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.188912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91b779-d6c9-4f3b-9530-e2396f103c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.189256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91b779-d6c9-4f3b-9530-e2396f103c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.189983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91b779-d6c9-4f3b-9530-e2396f103c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:15.191784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91b779-d6c9-4f3b-9530-e2396f103c3a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:15.193805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:15.205214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 813/1600] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:15.208936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47302c52-96f1-4cdd-8b87-0b6e0752e1e1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:15.225086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47302c52-96f1-4cdd-8b87-0b6e0752e1e1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:15.232804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e65e5-d350-4278-b2c6-cd7d93ca55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:15.233606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e65e5-d350-4278-b2c6-cd7d93ca55ab admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.234110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e65e5-d350-4278-b2c6-cd7d93ca55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.235029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e65e5-d350-4278-b2c6-cd7d93ca55ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.236174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e65e5-d350-4278-b2c6-cd7d93ca55ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:15.239075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e65e5-d350-4278-b2c6-cd7d93ca55ab admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:15.253366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 788/1601] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:15.257335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91b779-d6c9-4f3b-9530-e2396f103c3a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:15.274682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91b779-d6c9-4f3b-9530-e2396f103c3a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:15.293102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940396c6-7534-4207-8d0b-39e63ad65eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:15.294048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940396c6-7534-4207-8d0b-39e63ad65eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.294454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940396c6-7534-4207-8d0b-39e63ad65eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.294669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940396c6-7534-4207-8d0b-39e63ad65eb8 admin admin] PATH_INFO: `/v3/projects/9786d940ab814992ad5ef2ad38c384a6/users/7f754ec4fe3349c592f76608d4f96b1a/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.335616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940396c6-7534-4207-8d0b-39e63ad65eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9786d940ab814992ad5ef2ad38c384a6, user_id=7f754ec4fe3349c592f76608d4f96b1a, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:15.341464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940396c6-7534-4207-8d0b-39e63ad65eb8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:15.374597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 814/1602] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:15 2022] PUT /identity/v3/projects/9786d940ab814992ad5ef2ad38c384a6/users/7f754ec4fe3349c592f76608d4f96b1a/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:15.387429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6cb46-7c44-4cd4-b059-5a30005afeb6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.387994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6cb46-7c44-4cd4-b059-5a30005afeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.388591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6cb46-7c44-4cd4-b059-5a30005afeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.448591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-31e6cb46-7c44-4cd4-b059-5a30005afeb6 None None] MFA Rules not processed for user `7f754ec4fe3349c592f76608d4f96b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:15.450003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-31e6cb46-7c44-4cd4-b059-5a30005afeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:15.621031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 789/1603] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:15.621670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940396c6-7534-4207-8d0b-39e63ad65eb8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:15.704361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940396c6-7534-4207-8d0b-39e63ad65eb8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:15.711059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c14ec-1e40-4033-b79f-ea904bb054c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:15.711059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c14ec-1e40-4033-b79f-ea904bb054c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.711059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c14ec-1e40-4033-b79f-ea904bb054c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.711059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c14ec-1e40-4033-b79f-ea904bb054c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.711866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c14ec-1e40-4033-b79f-ea904bb054c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:15.713927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c14ec-1e40-4033-b79f-ea904bb054c1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:15.746774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 815/1604] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:15 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:15.748391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6cb46-7c44-4cd4-b059-5a30005afeb6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:15.762364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6cb46-7c44-4cd4-b059-5a30005afeb6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:15.838240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d325a-f1ad-477b-b5c1-5c207cee954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:15.839051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d325a-f1ad-477b-b5c1-5c207cee954c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.839438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d325a-f1ad-477b-b5c1-5c207cee954c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.843965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d325a-f1ad-477b-b5c1-5c207cee954c admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.843965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d325a-f1ad-477b-b5c1-5c207cee954c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:15.844210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d325a-f1ad-477b-b5c1-5c207cee954c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:15.879336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 790/1605] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:15 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:15.883885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c14ec-1e40-4033-b79f-ea904bb054c1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:15.894966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c14ec-1e40-4033-b79f-ea904bb054c1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:15.900055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78749c02-46fa-4bc2-85ea-7ab686ff69b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:15.900703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78749c02-46fa-4bc2-85ea-7ab686ff69b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.901012 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78749c02-46fa-4bc2-85ea-7ab686ff69b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.901183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78749c02-46fa-4bc2-85ea-7ab686ff69b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.901964 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78749c02-46fa-4bc2-85ea-7ab686ff69b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:15.903723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78749c02-46fa-4bc2-85ea-7ab686ff69b5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:15.915952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 816/1606] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:15.920616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d325a-f1ad-477b-b5c1-5c207cee954c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:15.930707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d325a-f1ad-477b-b5c1-5c207cee954c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:15.935614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c024df-0dc5-4391-a8e0-917193fbf52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:15.936283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c024df-0dc5-4391-a8e0-917193fbf52a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.936560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c024df-0dc5-4391-a8e0-917193fbf52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.936915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c024df-0dc5-4391-a8e0-917193fbf52a admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.937601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c024df-0dc5-4391-a8e0-917193fbf52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:15.939291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c024df-0dc5-4391-a8e0-917193fbf52a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:15.940687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:15.952715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 791/1607] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:15.956978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78749c02-46fa-4bc2-85ea-7ab686ff69b5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:15.967138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78749c02-46fa-4bc2-85ea-7ab686ff69b5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:15.971562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8393a4c-ff6a-403c-87d2-e8c83ae9e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:15.972202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8393a4c-ff6a-403c-87d2-e8c83ae9e56d admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:15.972473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8393a4c-ff6a-403c-87d2-e8c83ae9e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:15.972808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8393a4c-ff6a-403c-87d2-e8c83ae9e56d admin admin] PATH_INFO: `/v3/projects/619f91275f034c6f9830208c26203e37/users/b64481f6d8ea4804b5770af3a928dec5/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:15.988243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8393a4c-ff6a-403c-87d2-e8c83ae9e56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=619f91275f034c6f9830208c26203e37, user_id=b64481f6d8ea4804b5770af3a928dec5, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:15.991055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8393a4c-ff6a-403c-87d2-e8c83ae9e56d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:16.004976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 817/1608] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:15 2022] PUT /identity/v3/projects/619f91275f034c6f9830208c26203e37/users/b64481f6d8ea4804b5770af3a928dec5/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:16.015935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c345a0-1f56-4ca7-9121-9a9ceda7cf9f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:16.016217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c345a0-1f56-4ca7-9121-9a9ceda7cf9f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:16.016484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c345a0-1f56-4ca7-9121-9a9ceda7cf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:16.046056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c5c345a0-1f56-4ca7-9121-9a9ceda7cf9f None None] MFA Rules not processed for user `b64481f6d8ea4804b5770af3a928dec5`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:16.047518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c5c345a0-1f56-4ca7-9121-9a9ceda7cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:16.113512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 792/1609] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:16.118035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8393a4c-ff6a-403c-87d2-e8c83ae9e56d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:16.181159 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8393a4c-ff6a-403c-87d2-e8c83ae9e56d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:16.187107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a331862-a739-414e-97c5-2460af4e7934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:16.187726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331862-a739-414e-97c5-2460af4e7934 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:16.188000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331862-a739-414e-97c5-2460af4e7934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:16.188268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331862-a739-414e-97c5-2460af4e7934 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:16.188905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a331862-a739-414e-97c5-2460af4e7934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:16.190836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a331862-a739-414e-97c5-2460af4e7934 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:16.223072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 818/1610] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:16 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:16.228295 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c345a0-1f56-4ca7-9121-9a9ceda7cf9f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:16.240632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c345a0-1f56-4ca7-9121-9a9ceda7cf9f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:16.306961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2701-408e-4d95-bb3e-0d22f0a126f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:16.307692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2701-408e-4d95-bb3e-0d22f0a126f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:16.307971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2701-408e-4d95-bb3e-0d22f0a126f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:16.308237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2701-408e-4d95-bb3e-0d22f0a126f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:16.308865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af2701-408e-4d95-bb3e-0d22f0a126f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:16.310867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af2701-408e-4d95-bb3e-0d22f0a126f4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:16.334700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 793/1611] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:16 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:16.338741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a331862-a739-414e-97c5-2460af4e7934 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:16.350846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a331862-a739-414e-97c5-2460af4e7934 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:16.357025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1436c96-86af-4673-8cd1-4704f587742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:16.357801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1436c96-86af-4673-8cd1-4704f587742b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:16.358081 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1436c96-86af-4673-8cd1-4704f587742b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:16.358353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1436c96-86af-4673-8cd1-4704f587742b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:16.359058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1436c96-86af-4673-8cd1-4704f587742b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:16.360728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1436c96-86af-4673-8cd1-4704f587742b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:16.362218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:16.375704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 819/1612] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:16.380460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2701-408e-4d95-bb3e-0d22f0a126f4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:16.394390 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2701-408e-4d95-bb3e-0d22f0a126f4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:16.401535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b96527-db31-46ef-849b-464207b3cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:16.402379 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b96527-db31-46ef-849b-464207b3cbab admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:16.402754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b96527-db31-46ef-849b-464207b3cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:16.408111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b96527-db31-46ef-849b-464207b3cbab admin admin] PATH_INFO: `/v3/projects/a8f3edbfeb09495a943230f14c7115c2/users/fb6ce67d575f4a66a1c42d56ff26b7ab/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:16.429388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b96527-db31-46ef-849b-464207b3cbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f3edbfeb09495a943230f14c7115c2, user_id=fb6ce67d575f4a66a1c42d56ff26b7ab, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:16.432187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b96527-db31-46ef-849b-464207b3cbab admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:16.450582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 794/1613] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:16 2022] PUT /identity/v3/projects/a8f3edbfeb09495a943230f14c7115c2/users/fb6ce67d575f4a66a1c42d56ff26b7ab/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:16.455323 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1436c96-86af-4673-8cd1-4704f587742b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:16.467048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1436c96-86af-4673-8cd1-4704f587742b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:16.569022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a639b4-5af4-4567-9b8b-4dc94e0fbbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:16.571914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a639b4-5af4-4567-9b8b-4dc94e0fbbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:16.572370 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a639b4-5af4-4567-9b8b-4dc94e0fbbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:16.572647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a639b4-5af4-4567-9b8b-4dc94e0fbbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:16.573380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a639b4-5af4-4567-9b8b-4dc94e0fbbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:16.575127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a639b4-5af4-4567-9b8b-4dc94e0fbbd0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:16.617317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b96527-db31-46ef-849b-464207b3cbab admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:16.629567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b96527-db31-46ef-849b-464207b3cbab admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:16.630248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 820/1614] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:16.644475 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddd225-a30b-459d-98c3-447d6ef9284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:16.644735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddd225-a30b-459d-98c3-447d6ef9284b admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:16.644958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddd225-a30b-459d-98c3-447d6ef9284b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:16.645155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddd225-a30b-459d-98c3-447d6ef9284b admin admin] PATH_INFO: `/v3/projects/a8f3edbfeb09495a943230f14c7115c2/users/fb6ce67d575f4a66a1c42d56ff26b7ab/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:16.648733 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddd225-a30b-459d-98c3-447d6ef9284b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f3edbfeb09495a943230f14c7115c2, user_id=fb6ce67d575f4a66a1c42d56ff26b7ab, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:16.651647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddd225-a30b-459d-98c3-447d6ef9284b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:16.681353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 795/1615] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:16 2022] PUT /identity/v3/projects/a8f3edbfeb09495a943230f14c7115c2/users/fb6ce67d575f4a66a1c42d56ff26b7ab/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:16.699306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0235-0949-466f-b942-68387f16d8ee None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:16.699586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0235-0949-466f-b942-68387f16d8ee None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:16.699856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0235-0949-466f-b942-68387f16d8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:16.736137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2dce0235-0949-466f-b942-68387f16d8ee None None] MFA Rules not processed for user `fb6ce67d575f4a66a1c42d56ff26b7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:16.737541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2dce0235-0949-466f-b942-68387f16d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:16.833944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 821/1616] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:16.844984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddd225-a30b-459d-98c3-447d6ef9284b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:16.846890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c0ddd225-a30b-459d-98c3-447d6ef9284b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:16.901250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:16.919392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddd225-a30b-459d-98c3-447d6ef9284b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:16.923319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d915dcd-3989-4353-8a49-c5ac1d875934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:16.923966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d915dcd-3989-4353-8a49-c5ac1d875934 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:16.924310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d915dcd-3989-4353-8a49-c5ac1d875934 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:16.924639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d915dcd-3989-4353-8a49-c5ac1d875934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:16.934159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d915dcd-3989-4353-8a49-c5ac1d875934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:16.936246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d915dcd-3989-4353-8a49-c5ac1d875934 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:16.949337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 796/1617] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:17.552802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0235-0949-466f-b942-68387f16d8ee None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:17.564325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0235-0949-466f-b942-68387f16d8ee None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:17.569622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2973de9-ab02-4efa-8041-f7bc9517d4a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:17.570672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2973de9-ab02-4efa-8041-f7bc9517d4a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:17.571065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2973de9-ab02-4efa-8041-f7bc9517d4a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:17.571591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2973de9-ab02-4efa-8041-f7bc9517d4a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:17.631389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2973de9-ab02-4efa-8041-f7bc9517d4a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:17.632831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2973de9-ab02-4efa-8041-f7bc9517d4a5 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:17.642717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 822/1618] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:20.319333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d915dcd-3989-4353-8a49-c5ac1d875934 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:20.321037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5d915dcd-3989-4353-8a49-c5ac1d875934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:20.403887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d915dcd-3989-4353-8a49-c5ac1d875934 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:20.410755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:20.411417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:20.411698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:20.411955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] PATH_INFO: `/v3/users/d7bc661f09c6410585a138e647ce0ae6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:20.413430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bc661f09c6410585a138e647ce0ae6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:20.415493 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:20.504015 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bc661f09c6410585a138e647ce0ae6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:20.505913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bc661f09c6410585a138e647ce0ae6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:20.519335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bc661f09c6410585a138e647ce0ae6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:20.532362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bc661f09c6410585a138e647ce0ae6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:20.533114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bc661f09c6410585a138e647ce0ae6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:20.553095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 797/1619] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:20 2022] DELETE /identity/v3/users/d7bc661f09c6410585a138e647ce0ae6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:20.564068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988db76-4930-4e10-ac2a-3664108a07a5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:20.564536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988db76-4930-4e10-ac2a-3664108a07a5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:20.564636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988db76-4930-4e10-ac2a-3664108a07a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:20.591182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a988db76-4930-4e10-ac2a-3664108a07a5 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:20.592889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a988db76-4930-4e10-ac2a-3664108a07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:20.606581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:20.668541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 823/1620] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:20.678613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:20.680336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:20.759192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65164d38-c561-4b1f-bb97-aee4c960d114 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:20.763226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac0bcd-a3e0-465c-b158-99b23ec720b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:20.765163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac0bcd-a3e0-465c-b158-99b23ec720b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:20.765616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac0bcd-a3e0-465c-b158-99b23ec720b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:20.766036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac0bcd-a3e0-465c-b158-99b23ec720b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:20.779584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac0bcd-a3e0-465c-b158-99b23ec720b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:20.781286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac0bcd-a3e0-465c-b158-99b23ec720b4 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:20.795024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 798/1621] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:21.317639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988db76-4930-4e10-ac2a-3664108a07a5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:21.319724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a988db76-4930-4e10-ac2a-3664108a07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:21.344505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988db76-4930-4e10-ac2a-3664108a07a5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:21.349959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:21.350726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:21.351139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:21.351501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] PATH_INFO: `/v3/projects/1a4f1f4ebdd142bcb5a2fe524c11cf32` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:21.352853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a4f1f4ebdd142bcb5a2fe524c11cf32)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:21.354872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:21.435941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4f1f4ebdd142bcb5a2fe524c11cf32', 'request_id': 'req-bd917bde-7912-4485-991a-7b59eb177ea2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.441504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4f1f4ebdd142bcb5a2fe524c11cf32', 'request_id': 'req-bd917bde-7912-4485-991a-7b59eb177ea2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.447599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4f1f4ebdd142bcb5a2fe524c11cf32', 'request_id': 'req-bd917bde-7912-4485-991a-7b59eb177ea2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.461567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] The token cache is being invalidate because project 1a4f1f4ebdd142bcb5a2fe524c11cf32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:21.461884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.462487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.464033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 824/1622] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:21 2022] DELETE /identity/v3/projects/1a4f1f4ebdd142bcb5a2fe524c11cf32 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:21.468370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac0bcd-a3e0-465c-b158-99b23ec720b4 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:21.473954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:21.479775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac0bcd-a3e0-465c-b158-99b23ec720b4 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:21.556046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:21.556755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:21.557241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:21.557560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] PATH_INFO: `/v3/users/cd75c0ed93f4466ca69de0c8d64381b6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:21.558830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd75c0ed93f4466ca69de0c8d64381b6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:21.560970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:21.611003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd75c0ed93f4466ca69de0c8d64381b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.611577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd75c0ed93f4466ca69de0c8d64381b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.618941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd75c0ed93f4466ca69de0c8d64381b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.632722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd75c0ed93f4466ca69de0c8d64381b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.633546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd75c0ed93f4466ca69de0c8d64381b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:21.648768 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 799/1623] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:21 2022] DELETE /identity/v3/users/cd75c0ed93f4466ca69de0c8d64381b6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:21.964753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:21.966310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:21.981790 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd917bde-7912-4485-991a-7b59eb177ea2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:22.117064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:22.117687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.117949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.118224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] PATH_INFO: `/v3/projects/6fea972c308f4e718746390e4a01bd52` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.119540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fea972c308f4e718746390e4a01bd52)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:22.122741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:22.124373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:22.126182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:22.200116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:22.207888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fea972c308f4e718746390e4a01bd52', 'request_id': 'req-d7b245b4-83e9-4de6-8991-e1b1283cc87d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:22.217471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fea972c308f4e718746390e4a01bd52', 'request_id': 'req-d7b245b4-83e9-4de6-8991-e1b1283cc87d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:22.225866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fea972c308f4e718746390e4a01bd52', 'request_id': 'req-d7b245b4-83e9-4de6-8991-e1b1283cc87d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:22.226585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a18ccf-315d-45b2-b3ea-b2e6bff05cd4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:22.245311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] The token cache is being invalidate because project 6fea972c308f4e718746390e4a01bd52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:22.245622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:22.247057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d7b245b4-83e9-4de6-8991-e1b1283cc87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:22.249167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 825/1624] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:21 2022] DELETE /identity/v3/projects/6fea972c308f4e718746390e4a01bd52 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:22.255021 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa110cbe-7147-4e44-bf8b-bd969fe18738 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.256498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa110cbe-7147-4e44-bf8b-bd969fe18738 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.256954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa110cbe-7147-4e44-bf8b-bd969fe18738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.293393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:22.309434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-aa110cbe-7147-4e44-bf8b-bd969fe18738 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:22.311341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-aa110cbe-7147-4e44-bf8b-bd969fe18738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:22.320494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67609ae-5e75-4fe5-9854-f0b59ca5edf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:22.321806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67609ae-5e75-4fe5-9854-f0b59ca5edf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.322480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67609ae-5e75-4fe5-9854-f0b59ca5edf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.322957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67609ae-5e75-4fe5-9854-f0b59ca5edf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.327517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c67609ae-5e75-4fe5-9854-f0b59ca5edf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:22.418983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67609ae-5e75-4fe5-9854-f0b59ca5edf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:22.421520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67609ae-5e75-4fe5-9854-f0b59ca5edf0 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:22.434425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 800/1625] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:22.447124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 826/1626] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:22.451297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c817bf4-f852-4432-926c-750e3957e187 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.451652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c817bf4-f852-4432-926c-750e3957e187 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.451985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c817bf4-f852-4432-926c-750e3957e187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.485659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0c817bf4-f852-4432-926c-750e3957e187 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:22.486847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0c817bf4-f852-4432-926c-750e3957e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:22.495333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 801/1627] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:22.499800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa110cbe-7147-4e44-bf8b-bd969fe18738 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:22.509863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa110cbe-7147-4e44-bf8b-bd969fe18738 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:22.515388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c8396-9138-48a2-90ca-aba67d276a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:22.516031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c8396-9138-48a2-90ca-aba67d276a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.516405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c8396-9138-48a2-90ca-aba67d276a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.516668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c8396-9138-48a2-90ca-aba67d276a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.517311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c8396-9138-48a2-90ca-aba67d276a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:22.517604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c8396-9138-48a2-90ca-aba67d276a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:22.519223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c8396-9138-48a2-90ca-aba67d276a39 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:22.533007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 827/1628] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:22.537998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c817bf4-f852-4432-926c-750e3957e187 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:22.548036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c817bf4-f852-4432-926c-750e3957e187 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:22.552936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3e127-c821-429a-bf64-254f52169f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:22.553542 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3e127-c821-429a-bf64-254f52169f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.553838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3e127-c821-429a-bf64-254f52169f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.554086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3e127-c821-429a-bf64-254f52169f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.554762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3e127-c821-429a-bf64-254f52169f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:22.556680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3e127-c821-429a-bf64-254f52169f98 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:22.603429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 802/1629] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:22 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:22.605589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c8396-9138-48a2-90ca-aba67d276a39 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:22.616589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c8396-9138-48a2-90ca-aba67d276a39 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:22.676073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bc05c-fcd1-44dc-8a41-7af4e3ade79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:22.676718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bc05c-fcd1-44dc-8a41-7af4e3ade79c admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.677000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bc05c-fcd1-44dc-8a41-7af4e3ade79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.677303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bc05c-fcd1-44dc-8a41-7af4e3ade79c admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.677934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bc05c-fcd1-44dc-8a41-7af4e3ade79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:22.679991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bc05c-fcd1-44dc-8a41-7af4e3ade79c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:22.706393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 828/1630] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:22 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:22.707708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3e127-c821-429a-bf64-254f52169f98 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:22.718326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3e127-c821-429a-bf64-254f52169f98 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:22.723855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df183a8-bc37-4e0b-aece-72a11a5612f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:22.724917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df183a8-bc37-4e0b-aece-72a11a5612f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.725199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df183a8-bc37-4e0b-aece-72a11a5612f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.725519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df183a8-bc37-4e0b-aece-72a11a5612f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.726585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df183a8-bc37-4e0b-aece-72a11a5612f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:22.728600 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df183a8-bc37-4e0b-aece-72a11a5612f1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:22.740001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 803/1631] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:22.744483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bc05c-fcd1-44dc-8a41-7af4e3ade79c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:22.755197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bc05c-fcd1-44dc-8a41-7af4e3ade79c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:22.759848 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10983f6f-9405-44ad-bf8f-6e24e277f3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:22.760456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10983f6f-9405-44ad-bf8f-6e24e277f3fc admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.760734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10983f6f-9405-44ad-bf8f-6e24e277f3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.761004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10983f6f-9405-44ad-bf8f-6e24e277f3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.761646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10983f6f-9405-44ad-bf8f-6e24e277f3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:22.763401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10983f6f-9405-44ad-bf8f-6e24e277f3fc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:22.774673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 829/1632] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:22.779087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df183a8-bc37-4e0b-aece-72a11a5612f1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:22.790309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df183a8-bc37-4e0b-aece-72a11a5612f1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:22.795153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ee2d-b0dc-4dac-8b9d-b4d297d165a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:22.795806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ee2d-b0dc-4dac-8b9d-b4d297d165a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.796081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ee2d-b0dc-4dac-8b9d-b4d297d165a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.796345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ee2d-b0dc-4dac-8b9d-b4d297d165a9 admin admin] PATH_INFO: `/v3/projects/0e8f9cd58fda4207a72a0fb97d72a2e6/users/ff8a0942b1fe4c9f9d2dbd7ced316c80/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.813473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760ee2d-b0dc-4dac-8b9d-b4d297d165a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8f9cd58fda4207a72a0fb97d72a2e6, user_id=ff8a0942b1fe4c9f9d2dbd7ced316c80, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:22.816196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760ee2d-b0dc-4dac-8b9d-b4d297d165a9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:22.832326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 804/1633] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:22 2022] PUT /identity/v3/projects/0e8f9cd58fda4207a72a0fb97d72a2e6/users/ff8a0942b1fe4c9f9d2dbd7ced316c80/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:22.843202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ba8ad-025e-4c8c-947d-b31866410d15 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:22.843490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ba8ad-025e-4c8c-947d-b31866410d15 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:22.843772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ba8ad-025e-4c8c-947d-b31866410d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:22.874351 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3d1ba8ad-025e-4c8c-947d-b31866410d15 None None] MFA Rules not processed for user `ff8a0942b1fe4c9f9d2dbd7ced316c80`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:22.875585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3d1ba8ad-025e-4c8c-947d-b31866410d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:22.901444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:22.959873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 830/1634] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:22.971787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ee2d-b0dc-4dac-8b9d-b4d297d165a9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:22.976086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8760ee2d-b0dc-4dac-8b9d-b4d297d165a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:23.037752 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ee2d-b0dc-4dac-8b9d-b4d297d165a9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:23.041400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0387f77-b5e8-4595-a508-d2b74a102b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:23.042010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0387f77-b5e8-4595-a508-d2b74a102b2b service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:23.042283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0387f77-b5e8-4595-a508-d2b74a102b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:23.042552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0387f77-b5e8-4595-a508-d2b74a102b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:23.051321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0387f77-b5e8-4595-a508-d2b74a102b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:23.052740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0387f77-b5e8-4595-a508-d2b74a102b2b service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:23.061796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 805/1635] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:24.821198 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ba8ad-025e-4c8c-947d-b31866410d15 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:24.822650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3d1ba8ad-025e-4c8c-947d-b31866410d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:24.932857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ba8ad-025e-4c8c-947d-b31866410d15 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:24.945645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:24.946650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:24.947093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:24.947509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] PATH_INFO: `/v3/users/7f754ec4fe3349c592f76608d4f96b1a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:24.948775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f754ec4fe3349c592f76608d4f96b1a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:24.951610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:25.029601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f754ec4fe3349c592f76608d4f96b1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.031230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f754ec4fe3349c592f76608d4f96b1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.041541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f754ec4fe3349c592f76608d4f96b1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.069996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f754ec4fe3349c592f76608d4f96b1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.070882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f754ec4fe3349c592f76608d4f96b1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.097151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 831/1636] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:24 2022] DELETE /identity/v3/users/7f754ec4fe3349c592f76608d4f96b1a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:25.101494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcd27a-11ac-4710-b624-605862842623 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:25.101968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcd27a-11ac-4710-b624-605862842623 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:25.102043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcd27a-11ac-4710-b624-605862842623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:25.124808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-eafcd27a-11ac-4710-b624-605862842623 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:25.126025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-eafcd27a-11ac-4710-b624-605862842623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:25.179155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:25.259333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 806/1637] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:25.267855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:25.269349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:25.370350 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:25.401237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b0178-86c0-494f-a41d-491397d68a5f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:25.409595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe822f70-cdf5-4371-8880-060bffaf2ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:25.410247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe822f70-cdf5-4371-8880-060bffaf2ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:25.410520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe822f70-cdf5-4371-8880-060bffaf2ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:25.410788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe822f70-cdf5-4371-8880-060bffaf2ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:25.431243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe822f70-cdf5-4371-8880-060bffaf2ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:25.433609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe822f70-cdf5-4371-8880-060bffaf2ad9 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:25.453232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 832/1638] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:25.774542 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcd27a-11ac-4710-b624-605862842623 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:25.776509 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-eafcd27a-11ac-4710-b624-605862842623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:25.793847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcd27a-11ac-4710-b624-605862842623 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:25.800921 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:25.803342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:25.804001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:25.804001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] PATH_INFO: `/v3/projects/9786d940ab814992ad5ef2ad38c384a6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:25.806121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9786d940ab814992ad5ef2ad38c384a6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:25.808377 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:25.866914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9786d940ab814992ad5ef2ad38c384a6', 'request_id': 'req-748d11b5-90cc-42b0-8f38-0a35fa67ed81'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.875837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9786d940ab814992ad5ef2ad38c384a6', 'request_id': 'req-748d11b5-90cc-42b0-8f38-0a35fa67ed81'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.883266 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9786d940ab814992ad5ef2ad38c384a6', 'request_id': 'req-748d11b5-90cc-42b0-8f38-0a35fa67ed81'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.901338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] The token cache is being invalidate because project 9786d940ab814992ad5ef2ad38c384a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:25.901338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.902033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:25.903642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 807/1639] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:25 2022] DELETE /identity/v3/projects/9786d940ab814992ad5ef2ad38c384a6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:25.907823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe822f70-cdf5-4371-8880-060bffaf2ad9 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:25.921977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe822f70-cdf5-4371-8880-060bffaf2ad9 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:25.986615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:25.987376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:25.987651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:25.987960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] PATH_INFO: `/v3/users/b64481f6d8ea4804b5770af3a928dec5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:25.989106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64481f6d8ea4804b5770af3a928dec5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:25.991165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:26.052616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64481f6d8ea4804b5770af3a928dec5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.053703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64481f6d8ea4804b5770af3a928dec5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.063122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64481f6d8ea4804b5770af3a928dec5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.077807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64481f6d8ea4804b5770af3a928dec5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.078789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64481f6d8ea4804b5770af3a928dec5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.101165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 833/1640] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:25 2022] DELETE /identity/v3/users/b64481f6d8ea4804b5770af3a928dec5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:26.504402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:26.505880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:26.520070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d11b5-90cc-42b0-8f38-0a35fa67ed81 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:26.565426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:26.566851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:26.600599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:26.601263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:26.601602 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:26.601940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] PATH_INFO: `/v3/projects/619f91275f034c6f9830208c26203e37` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:26.603334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619f91275f034c6f9830208c26203e37)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:26.605496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:26.654710 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c539427-b7ef-40e2-afa0-8b2fc0e0ab52 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:26.664612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:26.666095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619f91275f034c6f9830208c26203e37', 'request_id': 'req-7392042b-f641-47e8-ad58-47f539adb8b0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.675070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619f91275f034c6f9830208c26203e37', 'request_id': 'req-7392042b-f641-47e8-ad58-47f539adb8b0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.677643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:26.685685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619f91275f034c6f9830208c26203e37', 'request_id': 'req-7392042b-f641-47e8-ad58-47f539adb8b0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.702494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] The token cache is being invalidate because project 619f91275f034c6f9830208c26203e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:26.702787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.703449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.705235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 808/1641] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:26 2022] DELETE /identity/v3/projects/619f91275f034c6f9830208c26203e37 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:26.708985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:26.710328 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:26.722407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:26.723332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:26.723605 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:26.723876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] PATH_INFO: `/v3/users/ff8a0942b1fe4c9f9d2dbd7ced316c80` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:26.724988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8a0942b1fe4c9f9d2dbd7ced316c80)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:26.726947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:26.778309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8a0942b1fe4c9f9d2dbd7ced316c80'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.778957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392042b-f641-47e8-ad58-47f539adb8b0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:26.779185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8a0942b1fe4c9f9d2dbd7ced316c80'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.784878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:26.785612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:26.785941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:26.786202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] PATH_INFO: `/v3/users/fb6ce67d575f4a66a1c42d56ff26b7ab` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:26.787525 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6ce67d575f4a66a1c42d56ff26b7ab)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:26.787794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8a0942b1fe4c9f9d2dbd7ced316c80'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.789811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:26.803731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8a0942b1fe4c9f9d2dbd7ced316c80'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.804773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bb281912-8b04-4bc2-b258-c11a3d92b078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8a0942b1fe4c9f9d2dbd7ced316c80'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.822804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 834/1642] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:26 2022] DELETE /identity/v3/users/ff8a0942b1fe4c9f9d2dbd7ced316c80 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:26.827994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27830-9454-4863-abd5-ade46f08d0a4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:26.828325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27830-9454-4863-abd5-ade46f08d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:26.828583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27830-9454-4863-abd5-ade46f08d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:26.845312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6ce67d575f4a66a1c42d56ff26b7ab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.846105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6ce67d575f4a66a1c42d56ff26b7ab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.849748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f5b27830-9454-4863-abd5-ade46f08d0a4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:26.850980 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f5b27830-9454-4863-abd5-ade46f08d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:26.853988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6ce67d575f4a66a1c42d56ff26b7ab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.869313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6ce67d575f4a66a1c42d56ff26b7ab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.870046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6ce67d575f4a66a1c42d56ff26b7ab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:26.886954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 809/1643] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:26 2022] DELETE /identity/v3/users/fb6ce67d575f4a66a1c42d56ff26b7ab => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:26.917787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 835/1644] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:26.931487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:26.933101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:26.997201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b7cf3-606e-4042-84e8-01230583764a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:27.000880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d8d2-ca2f-4405-be90-75b2bb1e952b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:27.001491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d8d2-ca2f-4405-be90-75b2bb1e952b service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.001800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d8d2-ca2f-4405-be90-75b2bb1e952b service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.002071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d8d2-ca2f-4405-be90-75b2bb1e952b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.025331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:27.085013 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2d8d2-ca2f-4405-be90-75b2bb1e952b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:27.086455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2d8d2-ca2f-4405-be90-75b2bb1e952b service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:27.096433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 810/1645] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:27.327470 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27830-9454-4863-abd5-ade46f08d0a4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:27.329062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f5b27830-9454-4863-abd5-ade46f08d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:27.349022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27830-9454-4863-abd5-ade46f08d0a4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:27.360215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:27.362152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.363733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.364010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] PATH_INFO: `/v3/projects/a8f3edbfeb09495a943230f14c7115c2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.365706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f3edbfeb09495a943230f14c7115c2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:27.367430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:27.453567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:27.487329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f3edbfeb09495a943230f14c7115c2', 'request_id': 'req-d637c7f3-a43c-4d70-b52c-502f4b77a526'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.499294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f3edbfeb09495a943230f14c7115c2', 'request_id': 'req-d637c7f3-a43c-4d70-b52c-502f4b77a526'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.507200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f3edbfeb09495a943230f14c7115c2', 'request_id': 'req-d637c7f3-a43c-4d70-b52c-502f4b77a526'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.531179 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d8d2-ca2f-4405-be90-75b2bb1e952b service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:27.532686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fbe2d8d2-ca2f-4405-be90-75b2bb1e952b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:27.533152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] The token cache is being invalidate because project a8f3edbfeb09495a943230f14c7115c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:27.533548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.534807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d637c7f3-a43c-4d70-b52c-502f4b77a526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.542265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 836/1646] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:27 2022] DELETE /identity/v3/projects/a8f3edbfeb09495a943230f14c7115c2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:27.543823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffbd21-14fc-4b6f-a3a1-b85fa4429748 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.546272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffbd21-14fc-4b6f-a3a1-b85fa4429748 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.546618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffbd21-14fc-4b6f-a3a1-b85fa4429748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.577688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d8d2-ca2f-4405-be90-75b2bb1e952b service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:27.596641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e8ffbd21-14fc-4b6f-a3a1-b85fa4429748 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:27.597906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e8ffbd21-14fc-4b6f-a3a1-b85fa4429748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:27.680618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 837/1647] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:27.688030 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dc779-848f-48bc-9768-b19112abeca8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.688306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dc779-848f-48bc-9768-b19112abeca8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.688579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dc779-848f-48bc-9768-b19112abeca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.693852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:27.694510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.694801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.695100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] PATH_INFO: `/v3/projects/0e8f9cd58fda4207a72a0fb97d72a2e6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.696277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8f9cd58fda4207a72a0fb97d72a2e6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:27.699786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:27.713516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-129dc779-848f-48bc-9768-b19112abeca8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:27.714772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-129dc779-848f-48bc-9768-b19112abeca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:27.723727 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 838/1648] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:27.728647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dc779-848f-48bc-9768-b19112abeca8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:27.738692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dc779-848f-48bc-9768-b19112abeca8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:27.752783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c1123-d394-475b-b384-84848d65a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:27.753412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c1123-d394-475b-b384-84848d65a32f admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.753683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c1123-d394-475b-b384-84848d65a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.753945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c1123-d394-475b-b384-84848d65a32f admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.754595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c1123-d394-475b-b384-84848d65a32f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:27.754895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c1123-d394-475b-b384-84848d65a32f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:27.756535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c1123-d394-475b-b384-84848d65a32f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:27.773161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 839/1649] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:27.780290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c1123-d394-475b-b384-84848d65a32f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:27.781869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8f9cd58fda4207a72a0fb97d72a2e6', 'request_id': 'req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.794387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8f9cd58fda4207a72a0fb97d72a2e6', 'request_id': 'req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.802947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c1123-d394-475b-b384-84848d65a32f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:27.811918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8f9cd58fda4207a72a0fb97d72a2e6', 'request_id': 'req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.829952 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] The token cache is being invalidate because project 0e8f9cd58fda4207a72a0fb97d72a2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:27.830326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.831197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49fcc89c-a6ae-4554-90f7-3aa015ba5aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:27.837231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 811/1650] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:27 2022] DELETE /identity/v3/projects/0e8f9cd58fda4207a72a0fb97d72a2e6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:27.839284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899163f3-7ef3-4aa3-aee9-b99d2603e9c3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.839631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899163f3-7ef3-4aa3-aee9-b99d2603e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.839967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899163f3-7ef3-4aa3-aee9-b99d2603e9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.864080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-899163f3-7ef3-4aa3-aee9-b99d2603e9c3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:27.865786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-899163f3-7ef3-4aa3-aee9-b99d2603e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:27.869438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567771b1-948e-4e19-9035-a1e97d7904ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:27.870051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567771b1-948e-4e19-9035-a1e97d7904ee admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.870325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567771b1-948e-4e19-9035-a1e97d7904ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.870594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567771b1-948e-4e19-9035-a1e97d7904ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.871259 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567771b1-948e-4e19-9035-a1e97d7904ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:27.873639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567771b1-948e-4e19-9035-a1e97d7904ee admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:27.875906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 812/1651] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:27.884268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1579dc4-118e-40bf-ab17-7609eb81ba52 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.884547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1579dc4-118e-40bf-ab17-7609eb81ba52 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.884813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1579dc4-118e-40bf-ab17-7609eb81ba52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.908056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e1579dc4-118e-40bf-ab17-7609eb81ba52 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:27.909270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e1579dc4-118e-40bf-ab17-7609eb81ba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:27.914610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 840/1652] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:27 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:27.915844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567771b1-948e-4e19-9035-a1e97d7904ee admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:27.917547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-567771b1-948e-4e19-9035-a1e97d7904ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:27.944697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:27.952144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:27.986072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 813/1653] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:27.988824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567771b1-948e-4e19-9035-a1e97d7904ee admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:27.990814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1579dc4-118e-40bf-ab17-7609eb81ba52 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:27.993525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cafbb-2e20-4737-b5e5-00e70e7439b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:27.994142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cafbb-2e20-4737-b5e5-00e70e7439b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:27.994480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cafbb-2e20-4737-b5e5-00e70e7439b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:27.994714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cafbb-2e20-4737-b5e5-00e70e7439b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:27.995363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cafbb-2e20-4737-b5e5-00e70e7439b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:27.997304 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cafbb-2e20-4737-b5e5-00e70e7439b5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.001124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1579dc4-118e-40bf-ab17-7609eb81ba52 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.005713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668bbcd-f100-4230-a199-025022de2a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.006310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668bbcd-f100-4230-a199-025022de2a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.006590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668bbcd-f100-4230-a199-025022de2a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.006854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668bbcd-f100-4230-a199-025022de2a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.007916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668bbcd-f100-4230-a199-025022de2a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:28.008231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668bbcd-f100-4230-a199-025022de2a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.009939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668bbcd-f100-4230-a199-025022de2a5d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.023285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 841/1654] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:27 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:28.024607 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 814/1655] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:43:28.027056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cafbb-2e20-4737-b5e5-00e70e7439b5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.028791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668bbcd-f100-4230-a199-025022de2a5d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.038402 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cafbb-2e20-4737-b5e5-00e70e7439b5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.039296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668bbcd-f100-4230-a199-025022de2a5d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.043164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3f5db-7285-4b9d-929c-23266bcacc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.043791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3f5db-7285-4b9d-929c-23266bcacc9d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.043966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3146e-8709-45e7-9fc8-695253217360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.044248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3f5db-7285-4b9d-929c-23266bcacc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.044690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3f5db-7285-4b9d-929c-23266bcacc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.044999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3146e-8709-45e7-9fc8-695253217360 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.045380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3146e-8709-45e7-9fc8-695253217360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.046330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3f5db-7285-4b9d-929c-23266bcacc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.046460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3146e-8709-45e7-9fc8-695253217360 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.046606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3146e-8709-45e7-9fc8-695253217360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.047811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3f5db-7285-4b9d-929c-23266bcacc9d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.048477 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3146e-8709-45e7-9fc8-695253217360 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.058446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 842/1656] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:28.063431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3f5db-7285-4b9d-929c-23266bcacc9d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.075095 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3f5db-7285-4b9d-929c-23266bcacc9d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.079226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 815/1657] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:28 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:28.080636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302577a-9dd8-4119-9591-ae68d2565639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.081247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302577a-9dd8-4119-9591-ae68d2565639 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.081562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302577a-9dd8-4119-9591-ae68d2565639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.081953 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302577a-9dd8-4119-9591-ae68d2565639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.082776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302577a-9dd8-4119-9591-ae68d2565639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.083916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3146e-8709-45e7-9fc8-695253217360 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.084716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302577a-9dd8-4119-9591-ae68d2565639 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.101854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 843/1658] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:28.103637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302577a-9dd8-4119-9591-ae68d2565639 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.115652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302577a-9dd8-4119-9591-ae68d2565639 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.148440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3146e-8709-45e7-9fc8-695253217360 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.154139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7395f4d-5e8d-4a85-99b3-868736334a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.154746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7395f4d-5e8d-4a85-99b3-868736334a66 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.155065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7395f4d-5e8d-4a85-99b3-868736334a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.155337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7395f4d-5e8d-4a85-99b3-868736334a66 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.155976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7395f4d-5e8d-4a85-99b3-868736334a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.158017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7395f4d-5e8d-4a85-99b3-868736334a66 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.174298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2bb45-9e6b-46d7-b20b-6d17ec5091ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.174994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2bb45-9e6b-46d7-b20b-6d17ec5091ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.175268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2bb45-9e6b-46d7-b20b-6d17ec5091ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.175534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2bb45-9e6b-46d7-b20b-6d17ec5091ff admin admin] PATH_INFO: `/v3/projects/777c8fdde32748daa69d67ff60629e7b/users/363eb3e0ae464b61a95c4eeb77f951ff/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.181274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 816/1659] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:28 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:28.185536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7395f4d-5e8d-4a85-99b3-868736334a66 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.191380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2bb45-9e6b-46d7-b20b-6d17ec5091ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=777c8fdde32748daa69d67ff60629e7b, user_id=363eb3e0ae464b61a95c4eeb77f951ff, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.194040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2bb45-9e6b-46d7-b20b-6d17ec5091ff admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.195357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7395f4d-5e8d-4a85-99b3-868736334a66 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.200591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208c910-6065-43e5-9cd1-3d66d784da50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.201445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c910-6065-43e5-9cd1-3d66d784da50 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.201720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c910-6065-43e5-9cd1-3d66d784da50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.202010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c910-6065-43e5-9cd1-3d66d784da50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.202653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208c910-6065-43e5-9cd1-3d66d784da50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.204419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208c910-6065-43e5-9cd1-3d66d784da50 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.208509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 844/1660] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:28 2022] PUT /identity/v3/projects/777c8fdde32748daa69d67ff60629e7b/users/363eb3e0ae464b61a95c4eeb77f951ff/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:28.214719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 817/1661] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:28.219683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2bb45-9e6b-46d7-b20b-6d17ec5091ff admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.220291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645de59c-33b5-4431-9f70-47ea7acd163b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.220575 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645de59c-33b5-4431-9f70-47ea7acd163b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.220848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645de59c-33b5-4431-9f70-47ea7acd163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.248677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-645de59c-33b5-4431-9f70-47ea7acd163b None None] MFA Rules not processed for user `363eb3e0ae464b61a95c4eeb77f951ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:28.249947 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-645de59c-33b5-4431-9f70-47ea7acd163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:28.282133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2bb45-9e6b-46d7-b20b-6d17ec5091ff admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.287402 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be4bd-8e63-47c7-bfc4-dccb012534a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.288014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be4bd-8e63-47c7-bfc4-dccb012534a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.288294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be4bd-8e63-47c7-bfc4-dccb012534a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.288566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be4bd-8e63-47c7-bfc4-dccb012534a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.289207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078be4bd-8e63-47c7-bfc4-dccb012534a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.290817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078be4bd-8e63-47c7-bfc4-dccb012534a6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.302670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 845/1662] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:28.306537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be4bd-8e63-47c7-bfc4-dccb012534a6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.317100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be4bd-8e63-47c7-bfc4-dccb012534a6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.317517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 818/1663] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:28.321788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfe722-9fb3-4cfe-b797-50adaaeac6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.322322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe722-9fb3-4cfe-b797-50adaaeac6df admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.322595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe722-9fb3-4cfe-b797-50adaaeac6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.322862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe722-9fb3-4cfe-b797-50adaaeac6df admin admin] PATH_INFO: `/v3/projects/49c8f1acba25407a98ec267a83de763c/users/3851579d7f034722a0b0975fd38e049d/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.327495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:28.334513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645de59c-33b5-4431-9f70-47ea7acd163b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.336142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-645de59c-33b5-4431-9f70-47ea7acd163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:28.340898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfe722-9fb3-4cfe-b797-50adaaeac6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c8f1acba25407a98ec267a83de763c, user_id=3851579d7f034722a0b0975fd38e049d, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.344084 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfe722-9fb3-4cfe-b797-50adaaeac6df admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.350065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:28.360782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 846/1664] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:28 2022] PUT /identity/v3/projects/49c8f1acba25407a98ec267a83de763c/users/3851579d7f034722a0b0975fd38e049d/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:28.365869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299bb2b-83cd-4903-8a5a-3b38a4594a73 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.366147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299bb2b-83cd-4903-8a5a-3b38a4594a73 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.366410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299bb2b-83cd-4903-8a5a-3b38a4594a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.392059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0299bb2b-83cd-4903-8a5a-3b38a4594a73 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:28.393297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0299bb2b-83cd-4903-8a5a-3b38a4594a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:28.400374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645de59c-33b5-4431-9f70-47ea7acd163b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.447739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1020c-bdcc-4607-b6bc-cec71b4368a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.448466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1020c-bdcc-4607-b6bc-cec71b4368a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.448868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1020c-bdcc-4607-b6bc-cec71b4368a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.449289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1020c-bdcc-4607-b6bc-cec71b4368a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.452118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 847/1665] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:28.461958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299bb2b-83cd-4903-8a5a-3b38a4594a73 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.463403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0299bb2b-83cd-4903-8a5a-3b38a4594a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:28.506808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1020c-bdcc-4607-b6bc-cec71b4368a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.508305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1020c-bdcc-4607-b6bc-cec71b4368a5 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.525046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 819/1666] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:28.527246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299bb2b-83cd-4903-8a5a-3b38a4594a73 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.531519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f4ddc-0ffa-405c-bebf-ba0f50cd53dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.532194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4ddc-0ffa-405c-bebf-ba0f50cd53dd service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.532809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4ddc-0ffa-405c-bebf-ba0f50cd53dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.532809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4ddc-0ffa-405c-bebf-ba0f50cd53dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.543195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f4ddc-0ffa-405c-bebf-ba0f50cd53dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.545053 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f4ddc-0ffa-405c-bebf-ba0f50cd53dd service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.551254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1020c-bdcc-4607-b6bc-cec71b4368a5 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.556811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 848/1667] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:28.564352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1020c-bdcc-4607-b6bc-cec71b4368a5 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.570232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.571119 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.571393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.571660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] PATH_INFO: `/v3/users/363eb3e0ae464b61a95c4eeb77f951ff` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.572798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363eb3e0ae464b61a95c4eeb77f951ff)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.575440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.645301 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363eb3e0ae464b61a95c4eeb77f951ff'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:28.646525 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363eb3e0ae464b61a95c4eeb77f951ff'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:28.656954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363eb3e0ae464b61a95c4eeb77f951ff'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:28.679152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363eb3e0ae464b61a95c4eeb77f951ff'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:28.682112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363eb3e0ae464b61a95c4eeb77f951ff'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:28.688527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:28.706217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 820/1668] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:28 2022] DELETE /identity/v3/users/363eb3e0ae464b61a95c4eeb77f951ff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:28.710632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a613cf-1a00-4992-af95-db1fa4fa0cbb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.710951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a613cf-1a00-4992-af95-db1fa4fa0cbb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.711546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a613cf-1a00-4992-af95-db1fa4fa0cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.739678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f1a613cf-1a00-4992-af95-db1fa4fa0cbb None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:28.741324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f1a613cf-1a00-4992-af95-db1fa4fa0cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:28.843170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 849/1669] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:28.855803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:28.857531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:28.930175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85e59a-0344-4967-bb3d-bb4d48031636 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:28.934065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600ce26-e67a-4d96-821b-71722fca05d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:28.934684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600ce26-e67a-4d96-821b-71722fca05d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:28.935016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600ce26-e67a-4d96-821b-71722fca05d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:28.935388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600ce26-e67a-4d96-821b-71722fca05d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:28.945241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600ce26-e67a-4d96-821b-71722fca05d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:28.946753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600ce26-e67a-4d96-821b-71722fca05d1 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:28.956810 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 821/1670] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:29.384154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a613cf-1a00-4992-af95-db1fa4fa0cbb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:29.386438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f1a613cf-1a00-4992-af95-db1fa4fa0cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:29.401824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a613cf-1a00-4992-af95-db1fa4fa0cbb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:29.407092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:29.407738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:29.408151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:29.408260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] PATH_INFO: `/v3/projects/777c8fdde32748daa69d67ff60629e7b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:29.409418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777c8fdde32748daa69d67ff60629e7b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:29.411457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:29.441247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:29.475022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777c8fdde32748daa69d67ff60629e7b', 'request_id': 'req-c4524935-881e-48a8-b162-0b14f1d4f027'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:29.483501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777c8fdde32748daa69d67ff60629e7b', 'request_id': 'req-c4524935-881e-48a8-b162-0b14f1d4f027'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:29.491023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777c8fdde32748daa69d67ff60629e7b', 'request_id': 'req-c4524935-881e-48a8-b162-0b14f1d4f027'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:29.507140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] The token cache is being invalidate because project 777c8fdde32748daa69d67ff60629e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:29.507433 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:29.508030 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4524935-881e-48a8-b162-0b14f1d4f027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:29.511003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 850/1671] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:29 2022] DELETE /identity/v3/projects/777c8fdde32748daa69d67ff60629e7b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:29.515090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d5a7-d1cd-450b-8de0-81a4db0d0cd9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:29.515393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d5a7-d1cd-450b-8de0-81a4db0d0cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:29.515659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d5a7-d1cd-450b-8de0-81a4db0d0cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:29.537726 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-87f4d5a7-d1cd-450b-8de0-81a4db0d0cd9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:29.539032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-87f4d5a7-d1cd-450b-8de0-81a4db0d0cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:29.619743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 822/1672] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:29.626391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1419ddc-2b77-4503-9dbb-c4a49fc2377a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:29.626680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1419ddc-2b77-4503-9dbb-c4a49fc2377a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:29.626959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1419ddc-2b77-4503-9dbb-c4a49fc2377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:29.658090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d1419ddc-2b77-4503-9dbb-c4a49fc2377a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:29.659374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d1419ddc-2b77-4503-9dbb-c4a49fc2377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:29.668398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 851/1673] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:29.673386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4d5a7-d1cd-450b-8de0-81a4db0d0cd9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:29.684937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4d5a7-d1cd-450b-8de0-81a4db0d0cd9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:29.690718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78756b-6e49-4b21-9b04-80ad6ecbdaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:29.691400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78756b-6e49-4b21-9b04-80ad6ecbdaee admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:29.691675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78756b-6e49-4b21-9b04-80ad6ecbdaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:29.691945 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78756b-6e49-4b21-9b04-80ad6ecbdaee admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:29.692611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78756b-6e49-4b21-9b04-80ad6ecbdaee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:29.692911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78756b-6e49-4b21-9b04-80ad6ecbdaee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:29.694546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78756b-6e49-4b21-9b04-80ad6ecbdaee admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:29.711640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 823/1674] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:29.713034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1419ddc-2b77-4503-9dbb-c4a49fc2377a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:29.723283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1419ddc-2b77-4503-9dbb-c4a49fc2377a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:29.728752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac8b6b-e96c-48bc-941a-7b6991f1f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:29.729466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8b6b-e96c-48bc-941a-7b6991f1f7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:29.729831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8b6b-e96c-48bc-941a-7b6991f1f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:29.730160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8b6b-e96c-48bc-941a-7b6991f1f7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:29.730880 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac8b6b-e96c-48bc-941a-7b6991f1f7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:29.733100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac8b6b-e96c-48bc-941a-7b6991f1f7f9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:29.767698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 852/1675] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:29 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:29.769277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78756b-6e49-4b21-9b04-80ad6ecbdaee admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:29.779867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78756b-6e49-4b21-9b04-80ad6ecbdaee admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:29.841263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440b269-a32f-486d-88d5-01abf67ed6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:29.841884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440b269-a32f-486d-88d5-01abf67ed6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:29.842163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440b269-a32f-486d-88d5-01abf67ed6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:29.842433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440b269-a32f-486d-88d5-01abf67ed6e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:29.843165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440b269-a32f-486d-88d5-01abf67ed6e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:29.849852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440b269-a32f-486d-88d5-01abf67ed6e8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:29.880585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 824/1676] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:29 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:29.884517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac8b6b-e96c-48bc-941a-7b6991f1f7f9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:29.897488 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac8b6b-e96c-48bc-941a-7b6991f1f7f9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:29.903889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad68b-0a51-46e7-9f4b-b1b6ab3fb024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:29.904634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad68b-0a51-46e7-9f4b-b1b6ab3fb024 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:29.905018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad68b-0a51-46e7-9f4b-b1b6ab3fb024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:29.905335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad68b-0a51-46e7-9f4b-b1b6ab3fb024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:29.906861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ad68b-0a51-46e7-9f4b-b1b6ab3fb024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:29.908734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ad68b-0a51-46e7-9f4b-b1b6ab3fb024 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:29.923834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 853/1677] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:29.927719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440b269-a32f-486d-88d5-01abf67ed6e8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:29.942060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440b269-a32f-486d-88d5-01abf67ed6e8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:29.949123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eed4f-68ee-4efe-81f2-a97484774152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:29.949880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eed4f-68ee-4efe-81f2-a97484774152 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:29.950403 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eed4f-68ee-4efe-81f2-a97484774152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:29.951241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eed4f-68ee-4efe-81f2-a97484774152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:29.952584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eed4f-68ee-4efe-81f2-a97484774152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:29.954711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eed4f-68ee-4efe-81f2-a97484774152 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:29.971087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 825/1678] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:29.975049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad68b-0a51-46e7-9f4b-b1b6ab3fb024 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:29.987231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad68b-0a51-46e7-9f4b-b1b6ab3fb024 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:29.993893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a01ec-b38a-4622-8d41-015e12568ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:29.994822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a01ec-b38a-4622-8d41-015e12568ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:29.995414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a01ec-b38a-4622-8d41-015e12568ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:29.995821 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a01ec-b38a-4622-8d41-015e12568ee2 admin admin] PATH_INFO: `/v3/projects/b8c528edb6194eba91ba777bb04442c2/users/f5717afb3d464dcba9f26204c4da5ff5/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:30.021440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a01ec-b38a-4622-8d41-015e12568ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c528edb6194eba91ba777bb04442c2, user_id=f5717afb3d464dcba9f26204c4da5ff5, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:30.027047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a01ec-b38a-4622-8d41-015e12568ee2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:30.075212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 854/1679] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:29 2022] PUT /identity/v3/projects/b8c528edb6194eba91ba777bb04442c2/users/f5717afb3d464dcba9f26204c4da5ff5/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:30.085183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45693892-6a7b-4af1-8e21-311ee06949b2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:30.085469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45693892-6a7b-4af1-8e21-311ee06949b2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:30.085743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45693892-6a7b-4af1-8e21-311ee06949b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:30.093356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:30.126382 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-45693892-6a7b-4af1-8e21-311ee06949b2 None None] MFA Rules not processed for user `f5717afb3d464dcba9f26204c4da5ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:30.127929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-45693892-6a7b-4af1-8e21-311ee06949b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:30.227572 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 826/1680] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:30.233966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a01ec-b38a-4622-8d41-015e12568ee2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:30.330291 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a01ec-b38a-4622-8d41-015e12568ee2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:30.336699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbf931-aef1-4d04-a925-0d7d686e638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:30.337446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbf931-aef1-4d04-a925-0d7d686e638b admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:30.337948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbf931-aef1-4d04-a925-0d7d686e638b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:30.338287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbf931-aef1-4d04-a925-0d7d686e638b admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:30.339207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbf931-aef1-4d04-a925-0d7d686e638b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:30.344811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbf931-aef1-4d04-a925-0d7d686e638b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:30.418112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45693892-6a7b-4af1-8e21-311ee06949b2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:30.426098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 855/1681] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:30 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:30.440117 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45693892-6a7b-4af1-8e21-311ee06949b2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:30.626326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb521209-8f07-4927-a861-12955184f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:30.627210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb521209-8f07-4927-a861-12955184f144 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:30.627386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb521209-8f07-4927-a861-12955184f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:30.627514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb521209-8f07-4927-a861-12955184f144 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:30.628595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb521209-8f07-4927-a861-12955184f144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:30.635418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb521209-8f07-4927-a861-12955184f144 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:30.671169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 827/1682] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:30 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:30.673482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbf931-aef1-4d04-a925-0d7d686e638b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:30.693549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbf931-aef1-4d04-a925-0d7d686e638b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:30.706286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14214-ba90-47d0-a29b-f3d1c8a4eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:30.706911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14214-ba90-47d0-a29b-f3d1c8a4eb3a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:30.707305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14214-ba90-47d0-a29b-f3d1c8a4eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:30.707546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14214-ba90-47d0-a29b-f3d1c8a4eb3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:30.708320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba14214-ba90-47d0-a29b-f3d1c8a4eb3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:30.710235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba14214-ba90-47d0-a29b-f3d1c8a4eb3a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:30.751491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 856/1683] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:30.755955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb521209-8f07-4927-a861-12955184f144 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:30.766910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb521209-8f07-4927-a861-12955184f144 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:30.771482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f929db0-385e-4049-b76a-1ff4edea2f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:30.772795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f929db0-385e-4049-b76a-1ff4edea2f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:30.773069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f929db0-385e-4049-b76a-1ff4edea2f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:30.773335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f929db0-385e-4049-b76a-1ff4edea2f3d admin admin] PATH_INFO: `/v3/projects/af373b5400154455a726b7c65c23dbe9/users/380e2412b731487e9a7fcd2048ab8cf9/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:30.796659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f929db0-385e-4049-b76a-1ff4edea2f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af373b5400154455a726b7c65c23dbe9, user_id=380e2412b731487e9a7fcd2048ab8cf9, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:30.799393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f929db0-385e-4049-b76a-1ff4edea2f3d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:30.816607 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 828/1684] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:30 2022] PUT /identity/v3/projects/af373b5400154455a726b7c65c23dbe9/users/380e2412b731487e9a7fcd2048ab8cf9/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:30.820764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14214-ba90-47d0-a29b-f3d1c8a4eb3a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:30.832364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14214-ba90-47d0-a29b-f3d1c8a4eb3a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:30.861686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:30.910570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583563-0578-4fa2-83af-f4d198529408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:30.911222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583563-0578-4fa2-83af-f4d198529408 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:30.911494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583563-0578-4fa2-83af-f4d198529408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:30.911760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583563-0578-4fa2-83af-f4d198529408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:30.912400 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c583563-0578-4fa2-83af-f4d198529408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:30.914387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c583563-0578-4fa2-83af-f4d198529408 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:30.931650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 857/1685] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:30.933578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f929db0-385e-4049-b76a-1ff4edea2f3d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:30.947993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f929db0-385e-4049-b76a-1ff4edea2f3d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:30.953649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d94ab-1ec2-4b0c-bea8-f367702da105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:30.954333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d94ab-1ec2-4b0c-bea8-f367702da105 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:30.954609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d94ab-1ec2-4b0c-bea8-f367702da105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:30.954880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d94ab-1ec2-4b0c-bea8-f367702da105 admin admin] PATH_INFO: `/v3/projects/af373b5400154455a726b7c65c23dbe9/users/380e2412b731487e9a7fcd2048ab8cf9/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:30.956871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d94ab-1ec2-4b0c-bea8-f367702da105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af373b5400154455a726b7c65c23dbe9, user_id=380e2412b731487e9a7fcd2048ab8cf9, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:30.959585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d94ab-1ec2-4b0c-bea8-f367702da105 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:30.970314 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 829/1686] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:30 2022] PUT /identity/v3/projects/af373b5400154455a726b7c65c23dbe9/users/380e2412b731487e9a7fcd2048ab8cf9/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:30.981866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9e06-4fb7-4c33-a149-184b0b845a43 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:30.982143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9e06-4fb7-4c33-a149-184b0b845a43 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:30.982415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9e06-4fb7-4c33-a149-184b0b845a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:31.010646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-848b9e06-4fb7-4c33-a149-184b0b845a43 None None] MFA Rules not processed for user `380e2412b731487e9a7fcd2048ab8cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:31.011891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-848b9e06-4fb7-4c33-a149-184b0b845a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:31.100660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 858/1687] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:31.113008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d94ab-1ec2-4b0c-bea8-f367702da105 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:31.114879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ad8d94ab-1ec2-4b0c-bea8-f367702da105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:31.169428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:31.185119 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d94ab-1ec2-4b0c-bea8-f367702da105 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:31.190590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276df0f-469a-4ddc-8b85-f717f87e88f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:31.191358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276df0f-469a-4ddc-8b85-f717f87e88f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:31.191697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276df0f-469a-4ddc-8b85-f717f87e88f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:31.192029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276df0f-469a-4ddc-8b85-f717f87e88f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:31.259344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276df0f-469a-4ddc-8b85-f717f87e88f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:31.261395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276df0f-469a-4ddc-8b85-f717f87e88f3 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:31.272347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 830/1688] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:33.373896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9e06-4fb7-4c33-a149-184b0b845a43 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:33.375467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-848b9e06-4fb7-4c33-a149-184b0b845a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:33.485828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9e06-4fb7-4c33-a149-184b0b845a43 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:33.494166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:33.494979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:33.495363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:33.495815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] PATH_INFO: `/v3/users/f876e144a9394ee79d5b81ff08af7922` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:33.499013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f876e144a9394ee79d5b81ff08af7922)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:33.501494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:33.589966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:33.591622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f876e144a9394ee79d5b81ff08af7922'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:33.592543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f876e144a9394ee79d5b81ff08af7922'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:33.607855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f876e144a9394ee79d5b81ff08af7922'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:33.628190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f876e144a9394ee79d5b81ff08af7922'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:33.629194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f876e144a9394ee79d5b81ff08af7922'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:33.650424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 859/1689] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:33 2022] DELETE /identity/v3/users/f876e144a9394ee79d5b81ff08af7922 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:33.655201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242ce86-3140-4e7f-ac70-4608f67127c0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:33.655837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242ce86-3140-4e7f-ac70-4608f67127c0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:33.655837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242ce86-3140-4e7f-ac70-4608f67127c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:33.685129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b242ce86-3140-4e7f-ac70-4608f67127c0 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:33.691381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b242ce86-3140-4e7f-ac70-4608f67127c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:33.849209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 831/1690] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:33.862102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:33.864019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:33.990475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f8cbe-a66f-4965-acc8-76c8be2e4d36 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:33.997379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db712-445f-4a96-9a5d-8ec08bcedcd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:33.998080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db712-445f-4a96-9a5d-8ec08bcedcd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:33.998366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db712-445f-4a96-9a5d-8ec08bcedcd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:33.998635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db712-445f-4a96-9a5d-8ec08bcedcd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:34.015706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db712-445f-4a96-9a5d-8ec08bcedcd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:34.018064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db712-445f-4a96-9a5d-8ec08bcedcd9 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:34.055775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 860/1691] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:34.146626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad3972-845f-4c27-8b26-c8509038d6ab None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:34.146903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad3972-845f-4c27-8b26-c8509038d6ab None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:34.147206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad3972-845f-4c27-8b26-c8509038d6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:34.212929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db712-445f-4a96-9a5d-8ec08bcedcd9 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:34.215524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-927db712-445f-4a96-9a5d-8ec08bcedcd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:34.218193 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-63ad3972-845f-4c27-8b26-c8509038d6ab None None] MFA Rules not processed for user `3851579d7f034722a0b0975fd38e049d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:34.219160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-63ad3972-845f-4c27-8b26-c8509038d6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:34.234250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db712-445f-4a96-9a5d-8ec08bcedcd9 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:34.240753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:34.241402 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:34.241904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:34.242199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] PATH_INFO: `/v3/users/f5717afb3d464dcba9f26204c4da5ff5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:34.243672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5717afb3d464dcba9f26204c4da5ff5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:34.245944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:34.340583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5717afb3d464dcba9f26204c4da5ff5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:34.341342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5717afb3d464dcba9f26204c4da5ff5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:34.356107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5717afb3d464dcba9f26204c4da5ff5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:34.371587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 832/1692] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:34.376476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad3972-845f-4c27-8b26-c8509038d6ab None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:34.378137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-63ad3972-845f-4c27-8b26-c8509038d6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:34.392510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5717afb3d464dcba9f26204c4da5ff5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:34.393276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c10ee04-4d95-474a-a45f-d10ad7321e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5717afb3d464dcba9f26204c4da5ff5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:34.406406 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad3972-845f-4c27-8b26-c8509038d6ab None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:34.412942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729fa5c-fed7-4d6c-bccc-c9818f09f8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:34.413418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 861/1693] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:34 2022] DELETE /identity/v3/users/f5717afb3d464dcba9f26204c4da5ff5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:34.413824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729fa5c-fed7-4d6c-bccc-c9818f09f8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:34.414214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729fa5c-fed7-4d6c-bccc-c9818f09f8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:34.414586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729fa5c-fed7-4d6c-bccc-c9818f09f8b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:34.415370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729fa5c-fed7-4d6c-bccc-c9818f09f8b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:34.417568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729fa5c-fed7-4d6c-bccc-c9818f09f8b2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:34.417908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10391c53-d9f1-48f0-bea4-fdaf7395be22 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:34.418333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10391c53-d9f1-48f0-bea4-fdaf7395be22 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:34.418781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10391c53-d9f1-48f0-bea4-fdaf7395be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:34.448618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-10391c53-d9f1-48f0-bea4-fdaf7395be22 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:34.451240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-10391c53-d9f1-48f0-bea4-fdaf7395be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:34.475054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 833/1694] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:34 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:34.476396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729fa5c-fed7-4d6c-bccc-c9818f09f8b2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:34.491030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:34.517051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:34.608974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 862/1695] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:34.638587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10391c53-d9f1-48f0-bea4-fdaf7395be22 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:34.640806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-10391c53-d9f1-48f0-bea4-fdaf7395be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:34.650807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729fa5c-fed7-4d6c-bccc-c9818f09f8b2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:34.664496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49c40d-e6a2-4da4-8463-775671f7056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:34.669640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49c40d-e6a2-4da4-8463-775671f7056e admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:34.669994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49c40d-e6a2-4da4-8463-775671f7056e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:34.671743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49c40d-e6a2-4da4-8463-775671f7056e admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:34.671743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49c40d-e6a2-4da4-8463-775671f7056e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:34.673524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49c40d-e6a2-4da4-8463-775671f7056e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:34.728669 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 834/1696] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:34 2022] POST /identity/v3/users => generated 299 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:34.736209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49c40d-e6a2-4da4-8463-775671f7056e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:34.780372 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49c40d-e6a2-4da4-8463-775671f7056e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:34.789745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b817c-bf78-482c-8b41-f465a555c597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:34.790370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b817c-bf78-482c-8b41-f465a555c597 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:34.790642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b817c-bf78-482c-8b41-f465a555c597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:34.790906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b817c-bf78-482c-8b41-f465a555c597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:34.791770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b817c-bf78-482c-8b41-f465a555c597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:34.795157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b817c-bf78-482c-8b41-f465a555c597 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:34.803775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10391c53-d9f1-48f0-bea4-fdaf7395be22 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:34.807908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 835/1697] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:34.812946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b817c-bf78-482c-8b41-f465a555c597 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:34.837708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b817c-bf78-482c-8b41-f465a555c597 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:34.849556 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e1621-e8cb-49e4-b556-068c72d51f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:34.850654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e1621-e8cb-49e4-b556-068c72d51f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:34.850654 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e1621-e8cb-49e4-b556-068c72d51f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:34.851072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e1621-e8cb-49e4-b556-068c72d51f5d admin admin] PATH_INFO: `/v3/projects/cfc31c9773fb4945b36256bf67993d6a/users/52269b63e07d457294a3d5d7b52b22f1/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:34.886168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e1621-e8cb-49e4-b556-068c72d51f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc31c9773fb4945b36256bf67993d6a, user_id=52269b63e07d457294a3d5d7b52b22f1, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:34.889129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e1621-e8cb-49e4-b556-068c72d51f5d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:34.904270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848aeaa-158c-411c-b99e-a71b6faeb7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:34.905016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848aeaa-158c-411c-b99e-a71b6faeb7ef service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:34.905295 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848aeaa-158c-411c-b99e-a71b6faeb7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:34.905655 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848aeaa-158c-411c-b99e-a71b6faeb7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:34.912345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 836/1698] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:34 2022] PUT /identity/v3/projects/cfc31c9773fb4945b36256bf67993d6a/users/52269b63e07d457294a3d5d7b52b22f1/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:34.917420 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e1621-e8cb-49e4-b556-068c72d51f5d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:34.921579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848aeaa-158c-411c-b99e-a71b6faeb7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:34.927628 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848aeaa-158c-411c-b99e-a71b6faeb7ef service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:34.960478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 863/1699] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:35.029251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848aeaa-158c-411c-b99e-a71b6faeb7ef service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:35.034718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7848aeaa-158c-411c-b99e-a71b6faeb7ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:35.041022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e1621-e8cb-49e4-b556-068c72d51f5d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:35.055919 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a25c0-8ab7-4d22-94af-f91aea5d5ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:35.056629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a25c0-8ab7-4d22-94af-f91aea5d5ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:35.056969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a25c0-8ab7-4d22-94af-f91aea5d5ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:35.057243 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a25c0-8ab7-4d22-94af-f91aea5d5ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:35.057897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a25c0-8ab7-4d22-94af-f91aea5d5ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:35.059858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a25c0-8ab7-4d22-94af-f91aea5d5ef4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:35.065644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848aeaa-158c-411c-b99e-a71b6faeb7ef service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:35.072724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 837/1700] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:35.073844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:35.074572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:35.074855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:35.075226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] PATH_INFO: `/v3/projects/445ddf28dabe47539e7cc5b74d5353a7` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:35.076903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a25c0-8ab7-4d22-94af-f91aea5d5ef4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:35.078888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445ddf28dabe47539e7cc5b74d5353a7)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:35.083873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:35.100383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a25c0-8ab7-4d22-94af-f91aea5d5ef4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:35.112157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683adaa-0104-4340-9b7a-4965b1c899bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:35.113058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683adaa-0104-4340-9b7a-4965b1c899bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:35.113432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683adaa-0104-4340-9b7a-4965b1c899bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:35.113861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683adaa-0104-4340-9b7a-4965b1c899bd admin admin] PATH_INFO: `/v3/projects/cfc31c9773fb4945b36256bf67993d6a/users/52269b63e07d457294a3d5d7b52b22f1/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:35.116859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683adaa-0104-4340-9b7a-4965b1c899bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc31c9773fb4945b36256bf67993d6a, user_id=52269b63e07d457294a3d5d7b52b22f1, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:35.120616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683adaa-0104-4340-9b7a-4965b1c899bd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:35.136457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 838/1701] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:35 2022] PUT /identity/v3/projects/cfc31c9773fb4945b36256bf67993d6a/users/52269b63e07d457294a3d5d7b52b22f1/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:35.190073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445ddf28dabe47539e7cc5b74d5353a7', 'request_id': 'req-3fcb3c82-c384-44eb-962a-895c2b2cccd7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:35.206656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445ddf28dabe47539e7cc5b74d5353a7', 'request_id': 'req-3fcb3c82-c384-44eb-962a-895c2b2cccd7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:35.222286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445ddf28dabe47539e7cc5b74d5353a7', 'request_id': 'req-3fcb3c82-c384-44eb-962a-895c2b2cccd7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:35.268303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] The token cache is being invalidate because project 445ddf28dabe47539e7cc5b74d5353a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:35.268666 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:35.270137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3fcb3c82-c384-44eb-962a-895c2b2cccd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:35.273525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 864/1702] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:35 2022] DELETE /identity/v3/projects/445ddf28dabe47539e7cc5b74d5353a7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:35.278566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bf00d-2d85-4152-b2cb-0d3e81056659 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:35.278860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bf00d-2d85-4152-b2cb-0d3e81056659 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:35.279142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bf00d-2d85-4152-b2cb-0d3e81056659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:35.318747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-509bf00d-2d85-4152-b2cb-0d3e81056659 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:35.320471 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-509bf00d-2d85-4152-b2cb-0d3e81056659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:35.417842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:35.450041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 839/1703] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:35.458055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b841d-49f3-4b7e-8084-088db5cacdc1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:35.458585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b841d-49f3-4b7e-8084-088db5cacdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:35.458585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b841d-49f3-4b7e-8084-088db5cacdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:35.517119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f81b841d-49f3-4b7e-8084-088db5cacdc1 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:35.518423 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f81b841d-49f3-4b7e-8084-088db5cacdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:35.539167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 865/1704] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:35.544027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bf00d-2d85-4152-b2cb-0d3e81056659 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:35.565137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bf00d-2d85-4152-b2cb-0d3e81056659 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:35.579341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a87d2a-e525-4b33-88e8-80f7124fc05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:35.580441 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87d2a-e525-4b33-88e8-80f7124fc05a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:35.580925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87d2a-e525-4b33-88e8-80f7124fc05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:35.581393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87d2a-e525-4b33-88e8-80f7124fc05a admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:35.582338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a87d2a-e525-4b33-88e8-80f7124fc05a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:35.583165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a87d2a-e525-4b33-88e8-80f7124fc05a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:35.585989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a87d2a-e525-4b33-88e8-80f7124fc05a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:35.613015 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 840/1705] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:35.617249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b841d-49f3-4b7e-8084-088db5cacdc1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:35.634644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b841d-49f3-4b7e-8084-088db5cacdc1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:35.657321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e3291-5862-4750-8de7-bc021feb7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:35.657321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3291-5862-4750-8de7-bc021feb7a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:35.657321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3291-5862-4750-8de7-bc021feb7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:35.657321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3291-5862-4750-8de7-bc021feb7a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:35.658141 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e3291-5862-4750-8de7-bc021feb7a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:35.660884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e3291-5862-4750-8de7-bc021feb7a0b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:35.695313 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:35.748844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 866/1706] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:35 2022] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:35.750209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a87d2a-e525-4b33-88e8-80f7124fc05a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:35.758492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e3291-5862-4750-8de7-bc021feb7a0b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:35.766409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fd5e3291-5862-4750-8de7-bc021feb7a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:35.792550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a87d2a-e525-4b33-88e8-80f7124fc05a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:35.931183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccfffc-d7f7-40b3-b304-8c99a0e77e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:35.931925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccfffc-d7f7-40b3-b304-8c99a0e77e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:35.932293 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccfffc-d7f7-40b3-b304-8c99a0e77e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:35.932649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccfffc-d7f7-40b3-b304-8c99a0e77e84 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:35.933404 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccfffc-d7f7-40b3-b304-8c99a0e77e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:35.935845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccfffc-d7f7-40b3-b304-8c99a0e77e84 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:35.942866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e3291-5862-4750-8de7-bc021feb7a0b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:35.949854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:35.950981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:35.951445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:35.951987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] PATH_INFO: `/v3/projects/b8c528edb6194eba91ba777bb04442c2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:35.954312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c528edb6194eba91ba777bb04442c2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:35.957599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:35.978187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 841/1707] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:35 2022] POST /identity/v3/users => generated 281 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:35.984093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccfffc-d7f7-40b3-b304-8c99a0e77e84 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:36.011272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccfffc-d7f7-40b3-b304-8c99a0e77e84 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:36.018564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e202-249e-472b-9d1f-1db3454ccaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:36.019736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e202-249e-472b-9d1f-1db3454ccaaa admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:36.019736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e202-249e-472b-9d1f-1db3454ccaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:36.020334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e202-249e-472b-9d1f-1db3454ccaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:36.029325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92e202-249e-472b-9d1f-1db3454ccaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:36.032978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92e202-249e-472b-9d1f-1db3454ccaaa admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:36.055494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 842/1708] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:36.056913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e202-249e-472b-9d1f-1db3454ccaaa admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:36.070743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e202-249e-472b-9d1f-1db3454ccaaa admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:36.080801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c528edb6194eba91ba777bb04442c2', 'request_id': 'req-5d96de87-73b1-44f8-818d-db67ecb288bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.098209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c528edb6194eba91ba777bb04442c2', 'request_id': 'req-5d96de87-73b1-44f8-818d-db67ecb288bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.110205 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c528edb6194eba91ba777bb04442c2', 'request_id': 'req-5d96de87-73b1-44f8-818d-db67ecb288bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.137407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] The token cache is being invalidate because project b8c528edb6194eba91ba777bb04442c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:36.138009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.140253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.143602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 867/1709] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:35 2022] DELETE /identity/v3/projects/b8c528edb6194eba91ba777bb04442c2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:36.147283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:36.151389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:36.243380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e36fe7-3621-452e-b654-3ee2eb43621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:36.244090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e36fe7-3621-452e-b654-3ee2eb43621f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:36.244372 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e36fe7-3621-452e-b654-3ee2eb43621f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:36.244716 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e36fe7-3621-452e-b654-3ee2eb43621f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:36.248251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e36fe7-3621-452e-b654-3ee2eb43621f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:36.249920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e36fe7-3621-452e-b654-3ee2eb43621f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:36.269700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 843/1710] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:36.271231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e36fe7-3621-452e-b654-3ee2eb43621f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:36.274556 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-00e36fe7-3621-452e-b654-3ee2eb43621f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:36.300289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e36fe7-3621-452e-b654-3ee2eb43621f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:36.313588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532558ef-05c3-4ed6-b8ec-761da841eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:36.314284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532558ef-05c3-4ed6-b8ec-761da841eca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:36.315824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532558ef-05c3-4ed6-b8ec-761da841eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:36.316104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532558ef-05c3-4ed6-b8ec-761da841eca9 admin admin] PATH_INFO: `/v3/projects/470464f45a3a4552a787fabdb691146e/users/05d05a8b1190435a96e6f43ee725e78e/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:36.347818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96de87-73b1-44f8-818d-db67ecb288bc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:36.358279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:36.359431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:36.360063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:36.360568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] PATH_INFO: `/v3/users/380e2412b731487e9a7fcd2048ab8cf9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:36.362938 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=380e2412b731487e9a7fcd2048ab8cf9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:36.365590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:36.369864 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532558ef-05c3-4ed6-b8ec-761da841eca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470464f45a3a4552a787fabdb691146e, user_id=05d05a8b1190435a96e6f43ee725e78e, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:36.380664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532558ef-05c3-4ed6-b8ec-761da841eca9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:36.411020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 844/1711] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:36 2022] PUT /identity/v3/projects/470464f45a3a4552a787fabdb691146e/users/05d05a8b1190435a96e6f43ee725e78e/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:36.426034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78f8d3-ab0a-4d9f-af03-b5d54ea9a7b7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:36.426319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78f8d3-ab0a-4d9f-af03-b5d54ea9a7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:36.426651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78f8d3-ab0a-4d9f-af03-b5d54ea9a7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:36.431296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:36.492933 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380e2412b731487e9a7fcd2048ab8cf9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.497180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380e2412b731487e9a7fcd2048ab8cf9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.506621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380e2412b731487e9a7fcd2048ab8cf9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.519724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4f78f8d3-ab0a-4d9f-af03-b5d54ea9a7b7 None None] MFA Rules not processed for user `05d05a8b1190435a96e6f43ee725e78e`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:36.521056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4f78f8d3-ab0a-4d9f-af03-b5d54ea9a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:36.525587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380e2412b731487e9a7fcd2048ab8cf9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.526563 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380e2412b731487e9a7fcd2048ab8cf9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:36.551861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:36.563353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 868/1712] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:36 2022] DELETE /identity/v3/users/380e2412b731487e9a7fcd2048ab8cf9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:36.626823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 845/1713] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:36.676364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:36.678362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:36.822208 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19ea06-072f-4917-8040-18d37c2d0257 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:36.828185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98597676-15ea-4a61-ba01-ad5d9e345aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:36.829044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98597676-15ea-4a61-ba01-ad5d9e345aba service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:36.829371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98597676-15ea-4a61-ba01-ad5d9e345aba service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:36.829727 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98597676-15ea-4a61-ba01-ad5d9e345aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:36.926716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98597676-15ea-4a61-ba01-ad5d9e345aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:36.927343 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98597676-15ea-4a61-ba01-ad5d9e345aba service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:36.940940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 869/1714] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:36.958875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78f8d3-ab0a-4d9f-af03-b5d54ea9a7b7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:36.960490 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4f78f8d3-ab0a-4d9f-af03-b5d54ea9a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:37.111748 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78f8d3-ab0a-4d9f-af03-b5d54ea9a7b7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:37.197228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:37.198241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:37.198663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:37.199547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] PATH_INFO: `/v3/users/05d05a8b1190435a96e6f43ee725e78e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:37.203291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d05a8b1190435a96e6f43ee725e78e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:37.207855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:37.290787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d05a8b1190435a96e6f43ee725e78e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:37.291923 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d05a8b1190435a96e6f43ee725e78e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:37.301985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d05a8b1190435a96e6f43ee725e78e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:37.309077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:37.326814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d05a8b1190435a96e6f43ee725e78e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:37.327906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d05a8b1190435a96e6f43ee725e78e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:37.369998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 846/1715] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:36 2022] DELETE /identity/v3/users/05d05a8b1190435a96e6f43ee725e78e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:37.373521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d929c-35d6-4ca1-b50f-81de6066997a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:37.374089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d929c-35d6-4ca1-b50f-81de6066997a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:37.374276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d929c-35d6-4ca1-b50f-81de6066997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:37.449282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b08d929c-35d6-4ca1-b50f-81de6066997a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:37.450595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b08d929c-35d6-4ca1-b50f-81de6066997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:37.581776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:37.612786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 870/1716] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:37.635794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:37.639796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:37.822062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc089260-cc7d-4f8a-84ba-59b7b22b489f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:37.832196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c145d9-6f71-4a8d-907f-3c379e1bdccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:37.832842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c145d9-6f71-4a8d-907f-3c379e1bdccd service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:37.833117 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c145d9-6f71-4a8d-907f-3c379e1bdccd service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:37.833381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c145d9-6f71-4a8d-907f-3c379e1bdccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:37.871220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c145d9-6f71-4a8d-907f-3c379e1bdccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:37.871220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c145d9-6f71-4a8d-907f-3c379e1bdccd service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:37.904123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 847/1717] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:37.921795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d929c-35d6-4ca1-b50f-81de6066997a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:37.925654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b08d929c-35d6-4ca1-b50f-81de6066997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:37.966353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d929c-35d6-4ca1-b50f-81de6066997a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:37.983311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:37.987834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:37.988332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:37.991452 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] PATH_INFO: `/v3/projects/af373b5400154455a726b7c65c23dbe9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:37.996196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=af373b5400154455a726b7c65c23dbe9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:38.005504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:38.147995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af373b5400154455a726b7c65c23dbe9', 'request_id': 'req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:38.155034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af373b5400154455a726b7c65c23dbe9', 'request_id': 'req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:38.171737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af373b5400154455a726b7c65c23dbe9', 'request_id': 'req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:38.198334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] The token cache is being invalidate because project af373b5400154455a726b7c65c23dbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:38.198638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:38.199441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc72f8f4-638b-4c44-a691-3c0347f6ac8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:38.201468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 871/1718] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:37 2022] DELETE /identity/v3/projects/af373b5400154455a726b7c65c23dbe9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:38.206732 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3e3c5-2126-4270-81ce-2aee95eea9f7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:38.207253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3e3c5-2126-4270-81ce-2aee95eea9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:38.207361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3e3c5-2126-4270-81ce-2aee95eea9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:38.241272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-77d3e3c5-2126-4270-81ce-2aee95eea9f7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:38.242495 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-77d3e3c5-2126-4270-81ce-2aee95eea9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:38.341137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 848/1719] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:38.349317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7eeee-c53b-44bd-a164-ae27dffffb90 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:38.350750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7eeee-c53b-44bd-a164-ae27dffffb90 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:38.351306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7eeee-c53b-44bd-a164-ae27dffffb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:38.383514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a1a7eeee-c53b-44bd-a164-ae27dffffb90 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:38.387694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a1a7eeee-c53b-44bd-a164-ae27dffffb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:38.412157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 872/1720] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:38.417025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3e3c5-2126-4270-81ce-2aee95eea9f7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:38.432535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3e3c5-2126-4270-81ce-2aee95eea9f7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:38.442833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbab9e1-070f-45df-bf7d-7c9895db6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:38.443512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbab9e1-070f-45df-bf7d-7c9895db6965 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:38.443790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbab9e1-070f-45df-bf7d-7c9895db6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:38.444060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbab9e1-070f-45df-bf7d-7c9895db6965 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:38.445026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbab9e1-070f-45df-bf7d-7c9895db6965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:38.445026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbab9e1-070f-45df-bf7d-7c9895db6965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:38.448983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbab9e1-070f-45df-bf7d-7c9895db6965 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:38.474261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 849/1721] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:38.480918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7eeee-c53b-44bd-a164-ae27dffffb90 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:38.494330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7eeee-c53b-44bd-a164-ae27dffffb90 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:38.503963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01713bb-c0a1-4fc0-a6b6-24c960210525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:38.505551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01713bb-c0a1-4fc0-a6b6-24c960210525 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:38.506048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01713bb-c0a1-4fc0-a6b6-24c960210525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:38.507244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01713bb-c0a1-4fc0-a6b6-24c960210525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:38.509601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01713bb-c0a1-4fc0-a6b6-24c960210525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:38.512007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01713bb-c0a1-4fc0-a6b6-24c960210525 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:38.600770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 873/1722] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:38 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:38.605647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbab9e1-070f-45df-bf7d-7c9895db6965 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:38.646636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbab9e1-070f-45df-bf7d-7c9895db6965 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:38.857863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc52e05-6720-4b10-aa82-a0e069a483bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:38.858443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc52e05-6720-4b10-aa82-a0e069a483bf admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:38.858718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc52e05-6720-4b10-aa82-a0e069a483bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:38.858995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc52e05-6720-4b10-aa82-a0e069a483bf admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:38.859637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc52e05-6720-4b10-aa82-a0e069a483bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:38.861560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc52e05-6720-4b10-aa82-a0e069a483bf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:38.896893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:38.907005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 850/1723] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:38 2022] POST /identity/v3/users => generated 289 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:38.908437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01713bb-c0a1-4fc0-a6b6-24c960210525 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:38.921985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01713bb-c0a1-4fc0-a6b6-24c960210525 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:38.929625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5374-feb8-4289-868c-4fac51e2bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:38.930564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5374-feb8-4289-868c-4fac51e2bff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:38.931041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5374-feb8-4289-868c-4fac51e2bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:38.931621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5374-feb8-4289-868c-4fac51e2bff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:38.932444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff5374-feb8-4289-868c-4fac51e2bff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:38.936713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff5374-feb8-4289-868c-4fac51e2bff9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:38.960568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 874/1724] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:38.964944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc52e05-6720-4b10-aa82-a0e069a483bf admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:38.987913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc52e05-6720-4b10-aa82-a0e069a483bf admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:39.001138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da159b42-ba11-4feb-b137-047885b336f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:39.001779 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da159b42-ba11-4feb-b137-047885b336f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.002054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da159b42-ba11-4feb-b137-047885b336f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.002322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da159b42-ba11-4feb-b137-047885b336f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.003000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da159b42-ba11-4feb-b137-047885b336f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:39.006031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da159b42-ba11-4feb-b137-047885b336f3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:39.036496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 851/1725] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:39.037514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5374-feb8-4289-868c-4fac51e2bff9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:39.050985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5374-feb8-4289-868c-4fac51e2bff9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:39.064499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d308-4156-4f14-9996-b498448aeebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:39.065561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d308-4156-4f14-9996-b498448aeebc admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.065841 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d308-4156-4f14-9996-b498448aeebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.066163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d308-4156-4f14-9996-b498448aeebc admin admin] PATH_INFO: `/v3/projects/c9c8a459458f418a8c0839ee522caa53/users/4c77b61662d44d93ad67deba2e453d82/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.110485 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d308-4156-4f14-9996-b498448aeebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c8a459458f418a8c0839ee522caa53, user_id=4c77b61662d44d93ad67deba2e453d82, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:39.114462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d308-4156-4f14-9996-b498448aeebc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:39.150100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84c12-325b-49da-aca8-239d5e65b629 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.150521 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84c12-325b-49da-aca8-239d5e65b629 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.150996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84c12-325b-49da-aca8-239d5e65b629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.153947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 875/1726] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:39 2022] PUT /identity/v3/projects/c9c8a459458f418a8c0839ee522caa53/users/4c77b61662d44d93ad67deba2e453d82/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:39.225898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-06a84c12-325b-49da-aca8-239d5e65b629 None None] MFA Rules not processed for user `4c77b61662d44d93ad67deba2e453d82`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:39.227891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-06a84c12-325b-49da-aca8-239d5e65b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:39.260077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384daab-6fe8-4f74-bad9-a5dcd73080d0 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.260450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384daab-6fe8-4f74-bad9-a5dcd73080d0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.260834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384daab-6fe8-4f74-bad9-a5dcd73080d0 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.262963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 876/1727] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:43:39.271061 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e112e4-f8d8-4752-a69a-6745739e6333 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.271601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e112e4-f8d8-4752-a69a-6745739e6333 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.271981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e112e4-f8d8-4752-a69a-6745739e6333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.317547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b0e112e4-f8d8-4752-a69a-6745739e6333 None None] MFA Rules not processed for user `0f040c31c0d4439594404739d44a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:39.319774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b0e112e4-f8d8-4752-a69a-6745739e6333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:39.444842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 852/1728] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:39.460813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84c12-325b-49da-aca8-239d5e65b629 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:39.462731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-06a84c12-325b-49da-aca8-239d5e65b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:39.517658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 877/1729] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:43:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:39.519398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e112e4-f8d8-4752-a69a-6745739e6333 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:39.524922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b0e112e4-f8d8-4752-a69a-6745739e6333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:39.563493 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:39.584600 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84c12-325b-49da-aca8-239d5e65b629 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:39.590364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea5b23-7881-45df-a1e7-3e4b6fb483a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:39.592856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5b23-7881-45df-a1e7-3e4b6fb483a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.593286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5b23-7881-45df-a1e7-3e4b6fb483a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.595451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5b23-7881-45df-a1e7-3e4b6fb483a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.613623 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea5b23-7881-45df-a1e7-3e4b6fb483a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:39.619315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea5b23-7881-45df-a1e7-3e4b6fb483a3 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:39.651644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e112e4-f8d8-4752-a69a-6745739e6333 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:39.654028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 853/1730] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:39.655082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea5b23-7881-45df-a1e7-3e4b6fb483a3 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:39.658185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:39.659158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.659512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.659748 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-02ea5b23-7881-45df-a1e7-3e4b6fb483a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:39.659900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] PATH_INFO: `/v3/users/52d8410aace14d04848ada4f2bff174a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.661796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d8410aace14d04848ada4f2bff174a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:39.664869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:39.695463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea5b23-7881-45df-a1e7-3e4b6fb483a3 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:39.700090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:39.701254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.701553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.701805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] PATH_INFO: `/v3/projects/470464f45a3a4552a787fabdb691146e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.703075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=470464f45a3a4552a787fabdb691146e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:39.705625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:39.761548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d8410aace14d04848ada4f2bff174a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.763645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d8410aace14d04848ada4f2bff174a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.774347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d8410aace14d04848ada4f2bff174a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.788074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470464f45a3a4552a787fabdb691146e', 'request_id': 'req-71d7c640-57c3-4c32-b42f-a9834f6cfda8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.790114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d8410aace14d04848ada4f2bff174a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.790859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c64930c-c375-4158-a9de-c33021c51bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d8410aace14d04848ada4f2bff174a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.807924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470464f45a3a4552a787fabdb691146e', 'request_id': 'req-71d7c640-57c3-4c32-b42f-a9834f6cfda8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.824495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 878/1731] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:39 2022] DELETE /identity/v3/users/52d8410aace14d04848ada4f2bff174a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:39.829467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd20dc-7ffa-4a92-a157-6ba4d907ffab None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.830127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd20dc-7ffa-4a92-a157-6ba4d907ffab None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.830127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd20dc-7ffa-4a92-a157-6ba4d907ffab None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.831692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 879/1732] 10.222.0.46 () {54 vars in 961 bytes} [Mon Oct 24 13:43:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:43:39.831891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470464f45a3a4552a787fabdb691146e', 'request_id': 'req-71d7c640-57c3-4c32-b42f-a9834f6cfda8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.837093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e9a6-a3e7-4548-8d24-7221f8b2cd1d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.837372 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e9a6-a3e7-4548-8d24-7221f8b2cd1d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.837645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e9a6-a3e7-4548-8d24-7221f8b2cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.860307 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] The token cache is being invalidate because project 470464f45a3a4552a787fabdb691146e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:39.860699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.861055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-66a7e9a6-a3e7-4548-8d24-7221f8b2cd1d None None] MFA Rules not processed for user `0f040c31c0d4439594404739d44a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:39.862384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-66a7e9a6-a3e7-4548-8d24-7221f8b2cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:39.865983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-71d7c640-57c3-4c32-b42f-a9834f6cfda8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:39.877434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 854/1733] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:39 2022] DELETE /identity/v3/projects/470464f45a3a4552a787fabdb691146e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:39.878632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62c43e-7183-4ef6-8f81-5161e741e3b7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:39.880183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62c43e-7183-4ef6-8f81-5161e741e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:39.882338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62c43e-7183-4ef6-8f81-5161e741e3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:39.906561 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:39.937208 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8b62c43e-7183-4ef6-8f81-5161e741e3b7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:39.941974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8b62c43e-7183-4ef6-8f81-5161e741e3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:40.030787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 880/1734] 10.222.0.46 () {58 vars in 1058 bytes} [Mon Oct 24 13:43:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:40.039716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e9a6-a3e7-4548-8d24-7221f8b2cd1d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.063369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e9a6-a3e7-4548-8d24-7221f8b2cd1d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:40.083268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3551d-e364-4cf2-9edd-814cfd6e6f3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:40.084006 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3551d-e364-4cf2-9edd-814cfd6e6f3c service placement] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.084311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3551d-e364-4cf2-9edd-814cfd6e6f3c service placement] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.084580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3551d-e364-4cf2-9edd-814cfd6e6f3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.088187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-00a3551d-e364-4cf2-9edd-814cfd6e6f3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:40.122963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3551d-e364-4cf2-9edd-814cfd6e6f3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:40.124938 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3551d-e364-4cf2-9edd-814cfd6e6f3c service placement] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:40.155651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 881/1735] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:40.185633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 855/1736] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:40.194466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7b9c-7802-4021-8a9a-7ac83fec1492 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.195172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7b9c-7802-4021-8a9a-7ac83fec1492 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.195588 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7b9c-7802-4021-8a9a-7ac83fec1492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.252842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-160f7b9c-7802-4021-8a9a-7ac83fec1492 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:40.254584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-160f7b9c-7802-4021-8a9a-7ac83fec1492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:40.266315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62c43e-7183-4ef6-8f81-5161e741e3b7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.268685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8b62c43e-7183-4ef6-8f81-5161e741e3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:40.277573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 882/1737] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:40.279268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7b9c-7802-4021-8a9a-7ac83fec1492 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.301896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62c43e-7183-4ef6-8f81-5161e741e3b7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:40.309597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:40.311030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.311484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.311926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] PATH_INFO: `/v3/projects/867bbec9e6c74c43b064e79b1adbe575` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.313741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] RBAC: Authorizing `identity:delete_project(project_id=867bbec9e6c74c43b064e79b1adbe575)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:40.317122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:40.339761 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7b9c-7802-4021-8a9a-7ac83fec1492 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:40.356751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea314e5e-6143-46cf-a7cb-89811c4cfdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:40.358723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea314e5e-6143-46cf-a7cb-89811c4cfdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.359192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea314e5e-6143-46cf-a7cb-89811c4cfdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.359566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea314e5e-6143-46cf-a7cb-89811c4cfdf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.360352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea314e5e-6143-46cf-a7cb-89811c4cfdf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:40.360721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea314e5e-6143-46cf-a7cb-89811c4cfdf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:40.363034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea314e5e-6143-46cf-a7cb-89811c4cfdf8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:40.365332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:40.402078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 883/1738] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:40.406143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea314e5e-6143-46cf-a7cb-89811c4cfdf8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.426344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea314e5e-6143-46cf-a7cb-89811c4cfdf8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:40.456326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867bbec9e6c74c43b064e79b1adbe575', 'request_id': 'req-384ecce0-5fdd-41c6-a440-cf856ec0928a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:40.467904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867bbec9e6c74c43b064e79b1adbe575', 'request_id': 'req-384ecce0-5fdd-41c6-a440-cf856ec0928a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:40.487149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867bbec9e6c74c43b064e79b1adbe575', 'request_id': 'req-384ecce0-5fdd-41c6-a440-cf856ec0928a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:40.528326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] The token cache is being invalidate because project 867bbec9e6c74c43b064e79b1adbe575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:40.528696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:40.534223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-384ecce0-5fdd-41c6-a440-cf856ec0928a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:40.537907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 856/1739] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:40 2022] DELETE /identity/v3/projects/867bbec9e6c74c43b064e79b1adbe575 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:40.544270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542665a4-c57a-4a22-99a2-e7eebf415826 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.544570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542665a4-c57a-4a22-99a2-e7eebf415826 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.544892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542665a4-c57a-4a22-99a2-e7eebf415826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.568226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafc623-9dba-4f95-9c4c-0981d34451a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:40.568920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafc623-9dba-4f95-9c4c-0981d34451a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.569117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafc623-9dba-4f95-9c4c-0981d34451a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.569382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafc623-9dba-4f95-9c4c-0981d34451a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.570015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafc623-9dba-4f95-9c4c-0981d34451a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:40.571994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafc623-9dba-4f95-9c4c-0981d34451a0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:40.617104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-542665a4-c57a-4a22-99a2-e7eebf415826 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:40.624045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-542665a4-c57a-4a22-99a2-e7eebf415826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:40.637548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 857/1740] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:40.646673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef43aa-8463-4714-ac5b-406bc9c58be6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.647540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef43aa-8463-4714-ac5b-406bc9c58be6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.647951 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef43aa-8463-4714-ac5b-406bc9c58be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.663116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 884/1741] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:40 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:40.666623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafc623-9dba-4f95-9c4c-0981d34451a0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.676567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-eeafc623-9dba-4f95-9c4c-0981d34451a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:40.709486 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-23ef43aa-8463-4714-ac5b-406bc9c58be6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:40.713753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-23ef43aa-8463-4714-ac5b-406bc9c58be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:40.804926 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafc623-9dba-4f95-9c4c-0981d34451a0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:40.811206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee301c-e97c-4121-948d-20d8ac2e0f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:40.812145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee301c-e97c-4121-948d-20d8ac2e0f1f admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.812591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee301c-e97c-4121-948d-20d8ac2e0f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.813376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee301c-e97c-4121-948d-20d8ac2e0f1f admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.814281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee301c-e97c-4121-948d-20d8ac2e0f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:40.816050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 858/1742] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:40.818280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee301c-e97c-4121-948d-20d8ac2e0f1f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:40.820077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef43aa-8463-4714-ac5b-406bc9c58be6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.850137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef43aa-8463-4714-ac5b-406bc9c58be6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:40.857049 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b156525-2c6c-46ba-bd5e-38c7ddb150e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:40.858108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b156525-2c6c-46ba-bd5e-38c7ddb150e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.858390 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b156525-2c6c-46ba-bd5e-38c7ddb150e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.858726 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b156525-2c6c-46ba-bd5e-38c7ddb150e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.859980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b156525-2c6c-46ba-bd5e-38c7ddb150e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:40.860785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b156525-2c6c-46ba-bd5e-38c7ddb150e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:40.862890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b156525-2c6c-46ba-bd5e-38c7ddb150e1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:40.872457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 885/1743] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:40 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:40.873852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee301c-e97c-4121-948d-20d8ac2e0f1f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.877558 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 859/1744] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:40.881992 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b156525-2c6c-46ba-bd5e-38c7ddb150e1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.887180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee301c-e97c-4121-948d-20d8ac2e0f1f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:40.894473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc80cc2-12bb-4620-be58-eef9df2b0ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:40.895131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc80cc2-12bb-4620-be58-eef9df2b0ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.895409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc80cc2-12bb-4620-be58-eef9df2b0ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.895681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc80cc2-12bb-4620-be58-eef9df2b0ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.896547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc80cc2-12bb-4620-be58-eef9df2b0ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:40.898371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc80cc2-12bb-4620-be58-eef9df2b0ee9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:40.899502 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b156525-2c6c-46ba-bd5e-38c7ddb150e1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:40.906440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06976f94-993f-45f5-bd92-620c65d0fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:40.907427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06976f94-993f-45f5-bd92-620c65d0fc5a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.908154 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06976f94-993f-45f5-bd92-620c65d0fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.908610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06976f94-993f-45f5-bd92-620c65d0fc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.909611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06976f94-993f-45f5-bd92-620c65d0fc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:40.912514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06976f94-993f-45f5-bd92-620c65d0fc5a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:40.914336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 886/1745] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:40.915479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc80cc2-12bb-4620-be58-eef9df2b0ee9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.919785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:40.928157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc80cc2-12bb-4620-be58-eef9df2b0ee9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:40.934825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f4c4-d59a-4757-bdf9-c1378092416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:40.936046 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f4c4-d59a-4757-bdf9-c1378092416b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:40.937810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f4c4-d59a-4757-bdf9-c1378092416b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:40.938324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f4c4-d59a-4757-bdf9-c1378092416b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:40.939279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381f4c4-d59a-4757-bdf9-c1378092416b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:40.942769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381f4c4-d59a-4757-bdf9-c1378092416b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:40.959619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 887/1746] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:40.960596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f4c4-d59a-4757-bdf9-c1378092416b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.965415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 860/1747] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:40 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:40.969385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06976f94-993f-45f5-bd92-620c65d0fc5a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:40.974657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f4c4-d59a-4757-bdf9-c1378092416b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.026380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:41.044884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8311af-e904-4fe6-bfc4-7d608ab52086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.045998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8311af-e904-4fe6-bfc4-7d608ab52086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.046391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8311af-e904-4fe6-bfc4-7d608ab52086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.046824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8311af-e904-4fe6-bfc4-7d608ab52086 admin admin] PATH_INFO: `/v3/projects/d815e81ebfff424fadcc65fa010dee64/users/4e232ec8102e4f9a97c8030d35802585/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.073043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06976f94-993f-45f5-bd92-620c65d0fc5a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.081746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8311af-e904-4fe6-bfc4-7d608ab52086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d815e81ebfff424fadcc65fa010dee64, user_id=4e232ec8102e4f9a97c8030d35802585, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.082351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092681c-667a-488e-ab33-f2bcdae6215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.083163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092681c-667a-488e-ab33-f2bcdae6215a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.083595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092681c-667a-488e-ab33-f2bcdae6215a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.084260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092681c-667a-488e-ab33-f2bcdae6215a admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.084911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092681c-667a-488e-ab33-f2bcdae6215a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.087008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092681c-667a-488e-ab33-f2bcdae6215a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.087518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8311af-e904-4fe6-bfc4-7d608ab52086 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.108000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 888/1748] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:40 2022] PUT /identity/v3/projects/d815e81ebfff424fadcc65fa010dee64/users/4e232ec8102e4f9a97c8030d35802585/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:41.119305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af132cbf-a48e-4368-9eb3-19e00f06132f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.119755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af132cbf-a48e-4368-9eb3-19e00f06132f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.120052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af132cbf-a48e-4368-9eb3-19e00f06132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.124580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 861/1749] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:40 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:41.129155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092681c-667a-488e-ab33-f2bcdae6215a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:41.150659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092681c-667a-488e-ab33-f2bcdae6215a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.170817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-af132cbf-a48e-4368-9eb3-19e00f06132f None None] MFA Rules not processed for user `4e232ec8102e4f9a97c8030d35802585`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:41.173621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-af132cbf-a48e-4368-9eb3-19e00f06132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:41.250268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd28841-ef93-4386-a0d4-918029c5788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.251173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd28841-ef93-4386-a0d4-918029c5788a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.251558 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd28841-ef93-4386-a0d4-918029c5788a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.251923 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd28841-ef93-4386-a0d4-918029c5788a admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.252682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd28841-ef93-4386-a0d4-918029c5788a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.254487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd28841-ef93-4386-a0d4-918029c5788a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.277663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 862/1750] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:41.282573 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd28841-ef93-4386-a0d4-918029c5788a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:41.299657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd28841-ef93-4386-a0d4-918029c5788a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.305743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd7bd6-075c-4bfd-a215-dabed5fa7f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.306401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7bd6-075c-4bfd-a215-dabed5fa7f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.307412 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7bd6-075c-4bfd-a215-dabed5fa7f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.308036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7bd6-075c-4bfd-a215-dabed5fa7f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.309242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd7bd6-075c-4bfd-a215-dabed5fa7f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.311182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd7bd6-075c-4bfd-a215-dabed5fa7f65 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.329789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 889/1751] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:41.333417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af132cbf-a48e-4368-9eb3-19e00f06132f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:41.347511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 863/1752] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:41.348851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd7bd6-075c-4bfd-a215-dabed5fa7f65 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:41.354912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af132cbf-a48e-4368-9eb3-19e00f06132f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.359952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e55373-6828-4a26-83fa-dc7107190502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.360660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e55373-6828-4a26-83fa-dc7107190502 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.361139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e55373-6828-4a26-83fa-dc7107190502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.361341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e55373-6828-4a26-83fa-dc7107190502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.362037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e55373-6828-4a26-83fa-dc7107190502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.364088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e55373-6828-4a26-83fa-dc7107190502 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.366738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd7bd6-075c-4bfd-a215-dabed5fa7f65 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.381432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06374a0-636a-42f3-951c-e079530c965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.382124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06374a0-636a-42f3-951c-e079530c965f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.382394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06374a0-636a-42f3-951c-e079530c965f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.382658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06374a0-636a-42f3-951c-e079530c965f admin admin] PATH_INFO: `/v3/projects/867c59f2e0334340a93a05ea73bb111f/users/73f687d3db564c56bbb22b9bfec92c1a/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.411228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 890/1753] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:41 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:41.415185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e55373-6828-4a26-83fa-dc7107190502 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:41.417960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06374a0-636a-42f3-951c-e079530c965f admin admin] RBAC: Authorizing `identity:create_grant(project_id=867c59f2e0334340a93a05ea73bb111f, user_id=73f687d3db564c56bbb22b9bfec92c1a, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.425348 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06374a0-636a-42f3-951c-e079530c965f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.465269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 864/1754] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:41 2022] PUT /identity/v3/projects/867c59f2e0334340a93a05ea73bb111f/users/73f687d3db564c56bbb22b9bfec92c1a/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:41.467861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991022a4-e8da-4539-9ce6-d3f93be4a4c4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.468309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991022a4-e8da-4539-9ce6-d3f93be4a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.468823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991022a4-e8da-4539-9ce6-d3f93be4a4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.517549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-991022a4-e8da-4539-9ce6-d3f93be4a4c4 None None] MFA Rules not processed for user `73f687d3db564c56bbb22b9bfec92c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:41.519271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-991022a4-e8da-4539-9ce6-d3f93be4a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:41.553583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:41.597203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e55373-6828-4a26-83fa-dc7107190502 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.633118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 865/1755] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:41.646335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991022a4-e8da-4539-9ce6-d3f93be4a4c4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:41.648955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-991022a4-e8da-4539-9ce6-d3f93be4a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:41.666279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:41.686139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59459232-e5f3-4cf8-a8b8-100dd3a15385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.686644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59459232-e5f3-4cf8-a8b8-100dd3a15385 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.686947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59459232-e5f3-4cf8-a8b8-100dd3a15385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.687221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59459232-e5f3-4cf8-a8b8-100dd3a15385 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.688520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59459232-e5f3-4cf8-a8b8-100dd3a15385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.691405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59459232-e5f3-4cf8-a8b8-100dd3a15385 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.725185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 891/1756] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:41 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:41.729117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59459232-e5f3-4cf8-a8b8-100dd3a15385 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:41.746182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59459232-e5f3-4cf8-a8b8-100dd3a15385 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.753674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad779-2947-4a02-8f77-882111b66b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.754388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad779-2947-4a02-8f77-882111b66b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.754698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad779-2947-4a02-8f77-882111b66b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.754998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad779-2947-4a02-8f77-882111b66b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.756042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad779-2947-4a02-8f77-882111b66b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.758447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad779-2947-4a02-8f77-882111b66b5f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.780455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 892/1757] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:41.781737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad779-2947-4a02-8f77-882111b66b5f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:41.795357 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad779-2947-4a02-8f77-882111b66b5f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.801146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c6f97-083d-4a9a-a096-5acb33f340f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.802952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6f97-083d-4a9a-a096-5acb33f340f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.803439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6f97-083d-4a9a-a096-5acb33f340f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.803784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6f97-083d-4a9a-a096-5acb33f340f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.804941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c6f97-083d-4a9a-a096-5acb33f340f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.807913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c6f97-083d-4a9a-a096-5acb33f340f2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.816108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991022a4-e8da-4539-9ce6-d3f93be4a4c4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.824018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 893/1758] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:41.828942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c6f97-083d-4a9a-a096-5acb33f340f2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:41.831516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2cf1e-e758-4b90-9296-b96a32d774d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.832245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2cf1e-e758-4b90-9296-b96a32d774d6 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.832585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2cf1e-e758-4b90-9296-b96a32d774d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.832918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2cf1e-e758-4b90-9296-b96a32d774d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.856333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2cf1e-e758-4b90-9296-b96a32d774d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.863065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c6f97-083d-4a9a-a096-5acb33f340f2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:41.865148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2cf1e-e758-4b90-9296-b96a32d774d6 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:41.885996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807ac69-fc43-4c60-9dbd-2b867e136fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:41.886737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807ac69-fc43-4c60-9dbd-2b867e136fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:41.887049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807ac69-fc43-4c60-9dbd-2b867e136fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:41.887646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807ac69-fc43-4c60-9dbd-2b867e136fb4 admin admin] PATH_INFO: `/v3/projects/377fd100e7b84799a35f1d425b346342/users/9ca82c2ca5584011a21f66bdeade9331/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:41.906691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 866/1759] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:41.964482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807ac69-fc43-4c60-9dbd-2b867e136fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377fd100e7b84799a35f1d425b346342, user_id=9ca82c2ca5584011a21f66bdeade9331, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:41.971432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807ac69-fc43-4c60-9dbd-2b867e136fb4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:42.003884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 894/1760] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:41 2022] PUT /identity/v3/projects/377fd100e7b84799a35f1d425b346342/users/9ca82c2ca5584011a21f66bdeade9331/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:42.015697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61ae17-75af-4f51-ad89-27cc1b6e0772 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:42.015959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61ae17-75af-4f51-ad89-27cc1b6e0772 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:42.016238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61ae17-75af-4f51-ad89-27cc1b6e0772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:42.050527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fa61ae17-75af-4f51-ad89-27cc1b6e0772 None None] MFA Rules not processed for user `9ca82c2ca5584011a21f66bdeade9331`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:42.051911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fa61ae17-75af-4f51-ad89-27cc1b6e0772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:42.136384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 867/1761] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:42.141440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807ac69-fc43-4c60-9dbd-2b867e136fb4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:42.249174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807ac69-fc43-4c60-9dbd-2b867e136fb4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:42.257032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f74b8-7c34-4800-98a8-5f9c138b27ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:42.257682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f74b8-7c34-4800-98a8-5f9c138b27ec admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:42.263501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f74b8-7c34-4800-98a8-5f9c138b27ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:42.263501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f74b8-7c34-4800-98a8-5f9c138b27ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:42.265187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f74b8-7c34-4800-98a8-5f9c138b27ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:42.270852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f74b8-7c34-4800-98a8-5f9c138b27ec admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:42.332993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 895/1762] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:42 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:42.334262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61ae17-75af-4f51-ad89-27cc1b6e0772 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:42.356533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61ae17-75af-4f51-ad89-27cc1b6e0772 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:42.452454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:42.501794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2577-60cc-48dc-9cc0-b0d27dcfb617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:42.502677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2577-60cc-48dc-9cc0-b0d27dcfb617 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:42.502813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2577-60cc-48dc-9cc0-b0d27dcfb617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:42.503176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2577-60cc-48dc-9cc0-b0d27dcfb617 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:42.506528 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e2577-60cc-48dc-9cc0-b0d27dcfb617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:42.508707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e2577-60cc-48dc-9cc0-b0d27dcfb617 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:42.557552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 868/1763] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:42 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:42.560593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f74b8-7c34-4800-98a8-5f9c138b27ec admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:42.578341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f74b8-7c34-4800-98a8-5f9c138b27ec admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:42.584024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7999e4-cf5a-48e3-a1b4-f1d230ad7243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:42.584876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7999e4-cf5a-48e3-a1b4-f1d230ad7243 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:42.585277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7999e4-cf5a-48e3-a1b4-f1d230ad7243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:42.585642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7999e4-cf5a-48e3-a1b4-f1d230ad7243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:42.586425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7999e4-cf5a-48e3-a1b4-f1d230ad7243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:42.589491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7999e4-cf5a-48e3-a1b4-f1d230ad7243 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:42.608282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 896/1764] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:42.609346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2577-60cc-48dc-9cc0-b0d27dcfb617 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:42.623245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2577-60cc-48dc-9cc0-b0d27dcfb617 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:42.638504 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016602c-ef89-403c-96d9-0255722d20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:42.640283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016602c-ef89-403c-96d9-0255722d20b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:42.641107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016602c-ef89-403c-96d9-0255722d20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:42.641107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016602c-ef89-403c-96d9-0255722d20b9 admin admin] PATH_INFO: `/v3/projects/f16f10e238964c7e8eb52a9f805ebdbf/users/be72d79f34754c2d9d7de964948fa6ad/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:42.674511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016602c-ef89-403c-96d9-0255722d20b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16f10e238964c7e8eb52a9f805ebdbf, user_id=be72d79f34754c2d9d7de964948fa6ad, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:42.685460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016602c-ef89-403c-96d9-0255722d20b9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:42.707169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 869/1765] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:42 2022] PUT /identity/v3/projects/f16f10e238964c7e8eb52a9f805ebdbf/users/be72d79f34754c2d9d7de964948fa6ad/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:42.711136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7999e4-cf5a-48e3-a1b4-f1d230ad7243 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:42.726258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7999e4-cf5a-48e3-a1b4-f1d230ad7243 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:42.796385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42d75b-0723-43f0-95b3-c0ed7ef7d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:42.797000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42d75b-0723-43f0-95b3-c0ed7ef7d7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:42.797271 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42d75b-0723-43f0-95b3-c0ed7ef7d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:42.797966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42d75b-0723-43f0-95b3-c0ed7ef7d7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:42.798166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42d75b-0723-43f0-95b3-c0ed7ef7d7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:42.799884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42d75b-0723-43f0-95b3-c0ed7ef7d7b7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:42.804242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:42.818621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 897/1766] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:42.819624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016602c-ef89-403c-96d9-0255722d20b9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:42.838775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016602c-ef89-403c-96d9-0255722d20b9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:42.844579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e1e5-965f-4814-be77-8a4e3f89c0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:42.845266 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e1e5-965f-4814-be77-8a4e3f89c0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:42.845551 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e1e5-965f-4814-be77-8a4e3f89c0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:42.845816 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e1e5-965f-4814-be77-8a4e3f89c0aa admin admin] PATH_INFO: `/v3/projects/f16f10e238964c7e8eb52a9f805ebdbf/users/be72d79f34754c2d9d7de964948fa6ad/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:42.847781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e1e5-965f-4814-be77-8a4e3f89c0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16f10e238964c7e8eb52a9f805ebdbf, user_id=be72d79f34754c2d9d7de964948fa6ad, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:42.850438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e1e5-965f-4814-be77-8a4e3f89c0aa admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:42.873843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 870/1767] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:42 2022] PUT /identity/v3/projects/f16f10e238964c7e8eb52a9f805ebdbf/users/be72d79f34754c2d9d7de964948fa6ad/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:42.878869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a66a-a091-4177-85e7-c80a2f9f3541 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:42.879721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a66a-a091-4177-85e7-c80a2f9f3541 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:42.879721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a66a-a091-4177-85e7-c80a2f9f3541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:42.910103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3940a66a-a091-4177-85e7-c80a2f9f3541 None None] MFA Rules not processed for user `be72d79f34754c2d9d7de964948fa6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:42.911547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3940a66a-a091-4177-85e7-c80a2f9f3541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:43.013172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 898/1768] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:43.030533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e1e5-965f-4814-be77-8a4e3f89c0aa admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:43.032512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9863e1e5-965f-4814-be77-8a4e3f89c0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:43.147844 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e1e5-965f-4814-be77-8a4e3f89c0aa admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:43.160401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279b14c-d0bd-4fca-96d8-72e3fb349ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:43.161052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279b14c-d0bd-4fca-96d8-72e3fb349ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:43.161368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279b14c-d0bd-4fca-96d8-72e3fb349ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:43.161642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279b14c-d0bd-4fca-96d8-72e3fb349ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:43.280949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279b14c-d0bd-4fca-96d8-72e3fb349ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:43.284454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279b14c-d0bd-4fca-96d8-72e3fb349ba7 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:43.296907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 871/1769] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:43.635564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172bfe8-7102-423d-a599-2d7d9f8870bb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:43.635870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172bfe8-7102-423d-a599-2d7d9f8870bb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:43.636139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172bfe8-7102-423d-a599-2d7d9f8870bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:43.683701 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f172bfe8-7102-423d-a599-2d7d9f8870bb None None] MFA Rules not processed for user `52269b63e07d457294a3d5d7b52b22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:43.685409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f172bfe8-7102-423d-a599-2d7d9f8870bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:43.808959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 899/1770] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:43.819806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279b14c-d0bd-4fca-96d8-72e3fb349ba7 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:43.822995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9279b14c-d0bd-4fca-96d8-72e3fb349ba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:43.926265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:43.944511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279b14c-d0bd-4fca-96d8-72e3fb349ba7 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:43.950192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8ec9210f54c6698477d7dbbe46a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:43.951289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:43.951744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:43.952181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:43.954765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:44.032581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:44.034019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:44.043562 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 872/1771] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:44.241646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f54a0-1c5c-42be-94ab-ee31f6796338 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:44.242091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f54a0-1c5c-42be-94ab-ee31f6796338 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:44.242422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f54a0-1c5c-42be-94ab-ee31f6796338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:44.264894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-506f54a0-1c5c-42be-94ab-ee31f6796338 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:44.266191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-506f54a0-1c5c-42be-94ab-ee31f6796338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:44.326309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 900/1772] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:43:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:44.371772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:44.373791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:44.447984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac8cf-6419-42a4-8db7-9c1473bc439a service glance] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:44.453298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79d0cc-2aa4-4e70-9779-2fd6ac536fd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:44.453989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79d0cc-2aa4-4e70-9779-2fd6ac536fd4 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:44.454329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79d0cc-2aa4-4e70-9779-2fd6ac536fd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:44.454655 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79d0cc-2aa4-4e70-9779-2fd6ac536fd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:44.463746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79d0cc-2aa4-4e70-9779-2fd6ac536fd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:44.465596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79d0cc-2aa4-4e70-9779-2fd6ac536fd4 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:44.477878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 873/1773] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:43:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:45.150755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f54a0-1c5c-42be-94ab-ee31f6796338 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:45.174281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:45.252235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79d0cc-2aa4-4e70-9779-2fd6ac536fd4 service swift] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:45.273670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79d0cc-2aa4-4e70-9779-2fd6ac536fd4 service swift] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:45.285922 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bffc61-a8f5-4391-8ff1-94860f439044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:45.286939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bffc61-a8f5-4391-8ff1-94860f439044 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:45.287379 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bffc61-a8f5-4391-8ff1-94860f439044 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:45.287925 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bffc61-a8f5-4391-8ff1-94860f439044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:45.307615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f54a0-1c5c-42be-94ab-ee31f6796338 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:45.317261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:45.318278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:45.318738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:45.319574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] PATH_INFO: `/v3/users/73f687d3db564c56bbb22b9bfec92c1a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:45.320869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f687d3db564c56bbb22b9bfec92c1a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:45.323178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:45.395807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bffc61-a8f5-4391-8ff1-94860f439044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:45.397517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bffc61-a8f5-4391-8ff1-94860f439044 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:45.409473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f687d3db564c56bbb22b9bfec92c1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:45.410573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f687d3db564c56bbb22b9bfec92c1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:45.412279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 874/1774] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:45.424007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f687d3db564c56bbb22b9bfec92c1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:45.440399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f687d3db564c56bbb22b9bfec92c1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:45.441468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f687d3db564c56bbb22b9bfec92c1a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:45.467188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 901/1775] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:45 2022] DELETE /identity/v3/users/73f687d3db564c56bbb22b9bfec92c1a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:45.468605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68656e99-84c6-4c55-8981-c352b55984a8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:45.468860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68656e99-84c6-4c55-8981-c352b55984a8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:45.469133 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68656e99-84c6-4c55-8981-c352b55984a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:45.502077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-68656e99-84c6-4c55-8981-c352b55984a8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:45.503500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-68656e99-84c6-4c55-8981-c352b55984a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:45.540926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:45.606963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 875/1776] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:45.615955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:45.617598 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:45.706422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5773e3-55b2-495a-b08c-1929320fd26d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:45.711556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f27efe-01dd-4cee-ba9d-85cdd7e84b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:45.712368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f27efe-01dd-4cee-ba9d-85cdd7e84b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:45.712642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f27efe-01dd-4cee-ba9d-85cdd7e84b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:45.712909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f27efe-01dd-4cee-ba9d-85cdd7e84b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:45.729893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f27efe-01dd-4cee-ba9d-85cdd7e84b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:45.732388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f27efe-01dd-4cee-ba9d-85cdd7e84b26 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:45.747173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 902/1777] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:46.219909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68656e99-84c6-4c55-8981-c352b55984a8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:46.221752 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-68656e99-84c6-4c55-8981-c352b55984a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:46.253858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68656e99-84c6-4c55-8981-c352b55984a8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:46.266434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:46.267316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:46.267668 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:46.268147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] PATH_INFO: `/v3/projects/867c59f2e0334340a93a05ea73bb111f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:46.269512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=867c59f2e0334340a93a05ea73bb111f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:46.272348 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:46.402363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867c59f2e0334340a93a05ea73bb111f', 'request_id': 'req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:46.413753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f27efe-01dd-4cee-ba9d-85cdd7e84b26 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:46.415157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867c59f2e0334340a93a05ea73bb111f', 'request_id': 'req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:46.415759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b0f27efe-01dd-4cee-ba9d-85cdd7e84b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:46.424283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867c59f2e0334340a93a05ea73bb111f', 'request_id': 'req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:46.448965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] The token cache is being invalidate because project 867c59f2e0334340a93a05ea73bb111f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:46.449421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:46.450319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f4caae63-b8b4-4086-98f7-50a1c9c5c8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:46.453921 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 876/1778] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:46 2022] DELETE /identity/v3/projects/867c59f2e0334340a93a05ea73bb111f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:46.459044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417606a-3513-4ace-9406-684bbd3bbabf None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:46.459450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417606a-3513-4ace-9406-684bbd3bbabf None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:46.459819 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417606a-3513-4ace-9406-684bbd3bbabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:46.477811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:46.496895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8417606a-3513-4ace-9406-684bbd3bbabf None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:46.499059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8417606a-3513-4ace-9406-684bbd3bbabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:46.514697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f27efe-01dd-4cee-ba9d-85cdd7e84b26 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:46.579878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 877/1779] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:46.588853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5492c65-3e5e-4cb3-984b-7b6b63e3955f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:46.589144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5492c65-3e5e-4cb3-984b-7b6b63e3955f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:46.589417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5492c65-3e5e-4cb3-984b-7b6b63e3955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:46.609901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550a22-b388-4b36-b276-a160443dbeca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:46.610686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550a22-b388-4b36-b276-a160443dbeca service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:46.611117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550a22-b388-4b36-b276-a160443dbeca service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:46.611500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550a22-b388-4b36-b276-a160443dbeca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:46.613334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-39550a22-b388-4b36-b276-a160443dbeca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:46.614569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c5492c65-3e5e-4cb3-984b-7b6b63e3955f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:46.616158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c5492c65-3e5e-4cb3-984b-7b6b63e3955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:46.625516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 878/1780] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:46.629690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5492c65-3e5e-4cb3-984b-7b6b63e3955f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:46.643539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5492c65-3e5e-4cb3-984b-7b6b63e3955f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:46.651213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a07abe-ccf2-47e5-8a8f-f64e3f3431a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:46.653358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a07abe-ccf2-47e5-8a8f-f64e3f3431a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:46.653767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a07abe-ccf2-47e5-8a8f-f64e3f3431a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:46.654337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a07abe-ccf2-47e5-8a8f-f64e3f3431a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:46.655697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a07abe-ccf2-47e5-8a8f-f64e3f3431a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:46.655697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a07abe-ccf2-47e5-8a8f-f64e3f3431a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:46.657578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a07abe-ccf2-47e5-8a8f-f64e3f3431a9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:46.677206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 879/1781] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:43:46.682305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a07abe-ccf2-47e5-8a8f-f64e3f3431a9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:46.703794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a07abe-ccf2-47e5-8a8f-f64e3f3431a9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:46.716025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a83a-2eb1-493e-a1ce-f9061706cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:46.718466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a83a-2eb1-493e-a1ce-f9061706cc72 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:46.719001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a83a-2eb1-493e-a1ce-f9061706cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:46.719220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a83a-2eb1-493e-a1ce-f9061706cc72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:46.719845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a83a-2eb1-493e-a1ce-f9061706cc72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:46.726182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a83a-2eb1-493e-a1ce-f9061706cc72 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:46.796201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 880/1782] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:46 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:46.800201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39550a22-b388-4b36-b276-a160443dbeca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:46.801682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39550a22-b388-4b36-b276-a160443dbeca service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:46.802329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a83a-2eb1-493e-a1ce-f9061706cc72 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:46.828774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:46.831369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 903/1783] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:46.998576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a83a-2eb1-493e-a1ce-f9061706cc72 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:47.040672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332f60-1316-48ae-b015-4f7460e6bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:47.040861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332f60-1316-48ae-b015-4f7460e6bfdd admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:47.041207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332f60-1316-48ae-b015-4f7460e6bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:47.041543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332f60-1316-48ae-b015-4f7460e6bfdd admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:47.042173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4332f60-1316-48ae-b015-4f7460e6bfdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:47.046831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4332f60-1316-48ae-b015-4f7460e6bfdd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:47.094617 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 881/1784] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:46 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:47.098664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550a22-b388-4b36-b276-a160443dbeca service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:47.114965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550a22-b388-4b36-b276-a160443dbeca service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:47.130089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276cf8-79bd-48a8-9a92-a216a6396064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:47.131257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276cf8-79bd-48a8-9a92-a216a6396064 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:47.131758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276cf8-79bd-48a8-9a92-a216a6396064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:47.132398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276cf8-79bd-48a8-9a92-a216a6396064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:47.133218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45276cf8-79bd-48a8-9a92-a216a6396064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:47.135244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45276cf8-79bd-48a8-9a92-a216a6396064 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:47.151666 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 904/1785] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:47.155797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332f60-1316-48ae-b015-4f7460e6bfdd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:47.173814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332f60-1316-48ae-b015-4f7460e6bfdd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:47.186519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fa10a-7cd6-44d6-af82-abd7aaca80fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:47.188863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fa10a-7cd6-44d6-af82-abd7aaca80fc admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:47.189258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fa10a-7cd6-44d6-af82-abd7aaca80fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:47.189785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fa10a-7cd6-44d6-af82-abd7aaca80fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:47.191708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fa10a-7cd6-44d6-af82-abd7aaca80fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:47.197729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fa10a-7cd6-44d6-af82-abd7aaca80fc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:47.226583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 882/1786] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:47.230460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276cf8-79bd-48a8-9a92-a216a6396064 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:47.246202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276cf8-79bd-48a8-9a92-a216a6396064 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:47.253947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64f3e8-5f7b-4a88-89c4-de044811c7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:47.256438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64f3e8-5f7b-4a88-89c4-de044811c7db admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:47.257354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64f3e8-5f7b-4a88-89c4-de044811c7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:47.257641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64f3e8-5f7b-4a88-89c4-de044811c7db admin admin] PATH_INFO: `/v3/projects/5715e74fc9504a25beaeb9337320fc12/users/c1138c95e7504b7996f38a630321bf18/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:47.307189 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64f3e8-5f7b-4a88-89c4-de044811c7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5715e74fc9504a25beaeb9337320fc12, user_id=c1138c95e7504b7996f38a630321bf18, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:47.310537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64f3e8-5f7b-4a88-89c4-de044811c7db admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:47.356040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 905/1787] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:47 2022] PUT /identity/v3/projects/5715e74fc9504a25beaeb9337320fc12/users/c1138c95e7504b7996f38a630321bf18/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:47.367865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937ec47-bd5f-4763-81cd-331444c2eca5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:47.368302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937ec47-bd5f-4763-81cd-331444c2eca5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:47.368445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937ec47-bd5f-4763-81cd-331444c2eca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:47.453412 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1937ec47-bd5f-4763-81cd-331444c2eca5 None None] MFA Rules not processed for user `c1138c95e7504b7996f38a630321bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:47.454784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1937ec47-bd5f-4763-81cd-331444c2eca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:47.573530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 883/1788] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:47.581206 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64f3e8-5f7b-4a88-89c4-de044811c7db admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:47.696165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64f3e8-5f7b-4a88-89c4-de044811c7db admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:47.701768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3028e0-897c-4d8c-abfd-d2bb18ab11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:47.702716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3028e0-897c-4d8c-abfd-d2bb18ab11dc admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:47.703232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3028e0-897c-4d8c-abfd-d2bb18ab11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:47.703498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3028e0-897c-4d8c-abfd-d2bb18ab11dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:47.704243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3028e0-897c-4d8c-abfd-d2bb18ab11dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:47.706040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3028e0-897c-4d8c-abfd-d2bb18ab11dc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:47.721595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:47.743355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 906/1789] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:47 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:47.747215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937ec47-bd5f-4763-81cd-331444c2eca5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:47.758410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937ec47-bd5f-4763-81cd-331444c2eca5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:47.829302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbc026-2851-437d-904e-66bf4e1dc5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:47.830222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbc026-2851-437d-904e-66bf4e1dc5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:47.830963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbc026-2851-437d-904e-66bf4e1dc5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:47.830963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbc026-2851-437d-904e-66bf4e1dc5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:47.831727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbc026-2851-437d-904e-66bf4e1dc5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:47.834276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbc026-2851-437d-904e-66bf4e1dc5a4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:47.861360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 884/1790] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:47 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:47.864908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3028e0-897c-4d8c-abfd-d2bb18ab11dc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:47.877986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3028e0-897c-4d8c-abfd-d2bb18ab11dc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:47.886769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26def3-f935-4c9c-96ef-8ff010ff2265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:47.890580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26def3-f935-4c9c-96ef-8ff010ff2265 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:47.890958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26def3-f935-4c9c-96ef-8ff010ff2265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:47.891356 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26def3-f935-4c9c-96ef-8ff010ff2265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:47.892088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26def3-f935-4c9c-96ef-8ff010ff2265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:47.893891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26def3-f935-4c9c-96ef-8ff010ff2265 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:47.906516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 907/1791] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:47.911892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbc026-2851-437d-904e-66bf4e1dc5a4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:47.928529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbc026-2851-437d-904e-66bf4e1dc5a4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:47.938550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927151c-8e97-4140-877b-4bc2bd416d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:47.940407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927151c-8e97-4140-877b-4bc2bd416d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:47.940407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927151c-8e97-4140-877b-4bc2bd416d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:47.940407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927151c-8e97-4140-877b-4bc2bd416d3c admin admin] PATH_INFO: `/v3/projects/f0eec8525ecc4f35aa1f3aaf54895307/users/7306989fb2544b88b43168e603e209f0/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:47.945510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:47.968429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927151c-8e97-4140-877b-4bc2bd416d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0eec8525ecc4f35aa1f3aaf54895307, user_id=7306989fb2544b88b43168e603e209f0, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:47.971666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927151c-8e97-4140-877b-4bc2bd416d3c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:47.994121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 885/1792] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:47 2022] PUT /identity/v3/projects/f0eec8525ecc4f35aa1f3aaf54895307/users/7306989fb2544b88b43168e603e209f0/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:47.998645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26def3-f935-4c9c-96ef-8ff010ff2265 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:48.009553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26def3-f935-4c9c-96ef-8ff010ff2265 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:48.134709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43362444-de85-4e03-b618-3be7bf30b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:48.135371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43362444-de85-4e03-b618-3be7bf30b0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:48.135645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43362444-de85-4e03-b618-3be7bf30b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:48.136505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43362444-de85-4e03-b618-3be7bf30b0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:48.137111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43362444-de85-4e03-b618-3be7bf30b0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:48.143256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43362444-de85-4e03-b618-3be7bf30b0fb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:48.164045 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 908/1793] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:48.167686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927151c-8e97-4140-877b-4bc2bd416d3c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:48.183917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927151c-8e97-4140-877b-4bc2bd416d3c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:48.189574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e194e8-aa15-4b64-9fc1-35598100d196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:48.190329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e194e8-aa15-4b64-9fc1-35598100d196 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:48.190674 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e194e8-aa15-4b64-9fc1-35598100d196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:48.191037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e194e8-aa15-4b64-9fc1-35598100d196 admin admin] PATH_INFO: `/v3/projects/f0eec8525ecc4f35aa1f3aaf54895307/users/7306989fb2544b88b43168e603e209f0/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:48.193184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e194e8-aa15-4b64-9fc1-35598100d196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0eec8525ecc4f35aa1f3aaf54895307, user_id=7306989fb2544b88b43168e603e209f0, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:48.196884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e194e8-aa15-4b64-9fc1-35598100d196 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:48.214990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 886/1794] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:48 2022] PUT /identity/v3/projects/f0eec8525ecc4f35aa1f3aaf54895307/users/7306989fb2544b88b43168e603e209f0/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:43:48.224523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ed069-7d5b-42e8-a819-bf42e370c3f2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:48.224803 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ed069-7d5b-42e8-a819-bf42e370c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:48.225329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ed069-7d5b-42e8-a819-bf42e370c3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:48.286866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-046ed069-7d5b-42e8-a819-bf42e370c3f2 None None] MFA Rules not processed for user `7306989fb2544b88b43168e603e209f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:48.288620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-046ed069-7d5b-42e8-a819-bf42e370c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:48.619547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 909/1795] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:48.709166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e194e8-aa15-4b64-9fc1-35598100d196 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:48.711141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a5e194e8-aa15-4b64-9fc1-35598100d196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:48.851299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e194e8-aa15-4b64-9fc1-35598100d196 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:48.856057 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c14285-7111-4824-961c-fc51c47be9c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:48.857519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c14285-7111-4824-961c-fc51c47be9c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:48.858332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c14285-7111-4824-961c-fc51c47be9c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:48.858747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c14285-7111-4824-961c-fc51c47be9c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:48.871804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c14285-7111-4824-961c-fc51c47be9c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:48.874240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c14285-7111-4824-961c-fc51c47be9c5 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:48.901184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 887/1796] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:48.953390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ed069-7d5b-42e8-a819-bf42e370c3f2 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:49.052041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ed069-7d5b-42e8-a819-bf42e370c3f2 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:49.057019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:49.057597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:49.057871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:49.058134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] PATH_INFO: `/v3/users/c1138c95e7504b7996f38a630321bf18` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:49.059310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1138c95e7504b7996f38a630321bf18)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:49.061295 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:49.064822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:49.149770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1138c95e7504b7996f38a630321bf18'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:49.151463 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1138c95e7504b7996f38a630321bf18'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:49.165759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1138c95e7504b7996f38a630321bf18'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:49.180414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1138c95e7504b7996f38a630321bf18'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:49.181553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1138c95e7504b7996f38a630321bf18'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:49.209906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 910/1797] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:48 2022] DELETE /identity/v3/users/c1138c95e7504b7996f38a630321bf18 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:49.214318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5a8c-dcac-4b26-9759-893f47bf4769 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:49.214978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5a8c-dcac-4b26-9759-893f47bf4769 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:49.215229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5a8c-dcac-4b26-9759-893f47bf4769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:49.240290 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e37c5a8c-dcac-4b26-9759-893f47bf4769 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:49.241604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e37c5a8c-dcac-4b26-9759-893f47bf4769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:49.317689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 888/1798] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:49.324109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:49.325633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:49.396538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56cae8-d8a2-4233-82f7-3c800a685727 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:49.401668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8be14-cd43-4be6-8b9a-f0523f6c3883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:49.402429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8be14-cd43-4be6-8b9a-f0523f6c3883 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:49.402765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8be14-cd43-4be6-8b9a-f0523f6c3883 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:49.403176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8be14-cd43-4be6-8b9a-f0523f6c3883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:49.416975 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8be14-cd43-4be6-8b9a-f0523f6c3883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:49.418536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8be14-cd43-4be6-8b9a-f0523f6c3883 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:49.437138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 911/1799] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:49.798879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c5a8c-dcac-4b26-9759-893f47bf4769 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:49.800394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e37c5a8c-dcac-4b26-9759-893f47bf4769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:49.830745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c5a8c-dcac-4b26-9759-893f47bf4769 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:49.862911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:49.864104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:49.864534 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:49.864954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] PATH_INFO: `/v3/projects/5715e74fc9504a25beaeb9337320fc12` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:49.867318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5715e74fc9504a25beaeb9337320fc12)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:49.874294 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:50.011319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5715e74fc9504a25beaeb9337320fc12', 'request_id': 'req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.022045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5715e74fc9504a25beaeb9337320fc12', 'request_id': 'req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.042114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5715e74fc9504a25beaeb9337320fc12', 'request_id': 'req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.066897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:50.080347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] The token cache is being invalidate because project 5715e74fc9504a25beaeb9337320fc12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:50.081723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.083966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.087807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 889/1800] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:49 2022] DELETE /identity/v3/projects/5715e74fc9504a25beaeb9337320fc12 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:50.091998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8be14-cd43-4be6-8b9a-f0523f6c3883 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:50.105816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8be14-cd43-4be6-8b9a-f0523f6c3883 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:50.226967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:50.227618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:50.227897 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:50.228162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] PATH_INFO: `/v3/users/7306989fb2544b88b43168e603e209f0` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:50.229280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7306989fb2544b88b43168e603e209f0)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:50.231785 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:50.309200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:50.343217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7306989fb2544b88b43168e603e209f0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.344491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7306989fb2544b88b43168e603e209f0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.359125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7306989fb2544b88b43168e603e209f0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.400239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7306989fb2544b88b43168e603e209f0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.401363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0a5d5b42-9a3d-4458-a26e-5097c41128b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7306989fb2544b88b43168e603e209f0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:50.429001 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 912/1801] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:50 2022] DELETE /identity/v3/users/7306989fb2544b88b43168e603e209f0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:50.882734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:50.884698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:50.902721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c5347-a9ef-4c5e-ab12-8687097d68f1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:50.984805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:50.984805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:50.984805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:50.984805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] PATH_INFO: `/v3/projects/f0eec8525ecc4f35aa1f3aaf54895307` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:50.986108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0eec8525ecc4f35aa1f3aaf54895307)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:50.988224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:51.047026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0eec8525ecc4f35aa1f3aaf54895307', 'request_id': 'req-438776e9-b7bd-4896-af27-1bd25e0c60f9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.056686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0eec8525ecc4f35aa1f3aaf54895307', 'request_id': 'req-438776e9-b7bd-4896-af27-1bd25e0c60f9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.063116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0eec8525ecc4f35aa1f3aaf54895307', 'request_id': 'req-438776e9-b7bd-4896-af27-1bd25e0c60f9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.090344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] The token cache is being invalidate because project f0eec8525ecc4f35aa1f3aaf54895307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:51.090723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.091602 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-438776e9-b7bd-4896-af27-1bd25e0c60f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.096893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 890/1802] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:50 2022] DELETE /identity/v3/projects/f0eec8525ecc4f35aa1f3aaf54895307 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:51.101467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3188-04a4-46c1-81ae-f71cab86dccd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.101932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3188-04a4-46c1-81ae-f71cab86dccd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.102057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3188-04a4-46c1-81ae-f71cab86dccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.135322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6ddb3188-04a4-46c1-81ae-f71cab86dccd None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:51.136653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6ddb3188-04a4-46c1-81ae-f71cab86dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:51.220522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 913/1803] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:51.230141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2615-b4d4-402d-95df-3e8f6de312e7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.230141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2615-b4d4-402d-95df-3e8f6de312e7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.230466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2615-b4d4-402d-95df-3e8f6de312e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.251786 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9bbb2615-b4d4-402d-95df-3e8f6de312e7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:51.253535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9bbb2615-b4d4-402d-95df-3e8f6de312e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:51.270082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 891/1804] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:51.274391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb3188-04a4-46c1-81ae-f71cab86dccd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:51.284398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb3188-04a4-46c1-81ae-f71cab86dccd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:51.298258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9454-fe23-4feb-b722-952360fd2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:51.299300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9454-fe23-4feb-b722-952360fd2720 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.299794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9454-fe23-4feb-b722-952360fd2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.300132 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9454-fe23-4feb-b722-952360fd2720 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.300853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb9454-fe23-4feb-b722-952360fd2720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:51.301357 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb9454-fe23-4feb-b722-952360fd2720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:51.303223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb9454-fe23-4feb-b722-952360fd2720 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:51.319593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 914/1805] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:43:51.324007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2615-b4d4-402d-95df-3e8f6de312e7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:51.335211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2615-b4d4-402d-95df-3e8f6de312e7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:51.339860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a077c6-1542-47c0-961b-ab78cd334b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:51.340600 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a077c6-1542-47c0-961b-ab78cd334b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.340909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a077c6-1542-47c0-961b-ab78cd334b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.341174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a077c6-1542-47c0-961b-ab78cd334b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.341869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a077c6-1542-47c0-961b-ab78cd334b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:51.343881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a077c6-1542-47c0-961b-ab78cd334b10 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:51.390719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9454-fe23-4feb-b722-952360fd2720 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:51.399256 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 892/1806] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:51 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:51.405368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9454-fe23-4feb-b722-952360fd2720 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:51.478175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd8e7-ea58-4033-9e41-a17324432939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:51.478891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd8e7-ea58-4033-9e41-a17324432939 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.479309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd8e7-ea58-4033-9e41-a17324432939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.479637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd8e7-ea58-4033-9e41-a17324432939 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.480359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bd8e7-ea58-4033-9e41-a17324432939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:51.482415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bd8e7-ea58-4033-9e41-a17324432939 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:51.506771 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 915/1807] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:51 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:51.510942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a077c6-1542-47c0-961b-ab78cd334b10 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:51.525135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a077c6-1542-47c0-961b-ab78cd334b10 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:51.530376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea88e86-bb12-422b-beaf-d6bd704ff978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:51.531158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea88e86-bb12-422b-beaf-d6bd704ff978 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.531497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea88e86-bb12-422b-beaf-d6bd704ff978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.531821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea88e86-bb12-422b-beaf-d6bd704ff978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.532541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea88e86-bb12-422b-beaf-d6bd704ff978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:51.534200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea88e86-bb12-422b-beaf-d6bd704ff978 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:51.549871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 893/1808] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:51.551101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd8e7-ea58-4033-9e41-a17324432939 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:51.563683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd8e7-ea58-4033-9e41-a17324432939 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:51.570982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30523-db74-4619-972c-d93bb5a63aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:51.571706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30523-db74-4619-972c-d93bb5a63aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.572023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30523-db74-4619-972c-d93bb5a63aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.572339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30523-db74-4619-972c-d93bb5a63aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.572939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc30523-db74-4619-972c-d93bb5a63aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:51.579479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc30523-db74-4619-972c-d93bb5a63aa4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:51.592627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 916/1809] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:51.596825 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea88e86-bb12-422b-beaf-d6bd704ff978 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:51.611423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea88e86-bb12-422b-beaf-d6bd704ff978 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:51.618025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b158f-cb74-4b97-a7a2-7d10acdec541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:51.618025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b158f-cb74-4b97-a7a2-7d10acdec541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.618025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b158f-cb74-4b97-a7a2-7d10acdec541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.618025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b158f-cb74-4b97-a7a2-7d10acdec541 admin admin] PATH_INFO: `/v3/projects/82f3a47bb2d642118ee8f7fce8a24bf6/users/b1a2cf2eed3e40ecad40ccf79a5d177a/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.640016 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30523-db74-4619-972c-d93bb5a63aa4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:51.640189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b158f-cb74-4b97-a7a2-7d10acdec541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f3a47bb2d642118ee8f7fce8a24bf6, user_id=b1a2cf2eed3e40ecad40ccf79a5d177a, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:51.644244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b158f-cb74-4b97-a7a2-7d10acdec541 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:51.649419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cdc30523-db74-4619-972c-d93bb5a63aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:51.668192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30523-db74-4619-972c-d93bb5a63aa4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:51.670972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 894/1810] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:51 2022] PUT /identity/v3/projects/82f3a47bb2d642118ee8f7fce8a24bf6/users/b1a2cf2eed3e40ecad40ccf79a5d177a/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:51.674544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:51.682275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3bc80-0ac2-4fb3-ad53-05bdb0d0bf53 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.682590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3bc80-0ac2-4fb3-ad53-05bdb0d0bf53 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.682956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3bc80-0ac2-4fb3-ad53-05bdb0d0bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.734219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fce3bc80-0ac2-4fb3-ad53-05bdb0d0bf53 None None] MFA Rules not processed for user `b1a2cf2eed3e40ecad40ccf79a5d177a`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:51.735847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fce3bc80-0ac2-4fb3-ad53-05bdb0d0bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:51.744126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:51.745039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.745322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.745759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] PATH_INFO: `/v3/users/4e232ec8102e4f9a97c8030d35802585` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.748190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e232ec8102e4f9a97c8030d35802585)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:51.750318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:51.750519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:51.823521 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e232ec8102e4f9a97c8030d35802585'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.824595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e232ec8102e4f9a97c8030d35802585'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.833897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 895/1811] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:51.836037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e232ec8102e4f9a97c8030d35802585'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.839101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3bc80-0ac2-4fb3-ad53-05bdb0d0bf53 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:51.855094 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3bc80-0ac2-4fb3-ad53-05bdb0d0bf53 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:51.858581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e232ec8102e4f9a97c8030d35802585'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.859593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d4320a04-4a6c-4b69-88ad-a2e6a0846410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e232ec8102e4f9a97c8030d35802585'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:51.861619 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82466c18-4095-470b-a75e-4860239b4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:51.862278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82466c18-4095-470b-a75e-4860239b4140 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.862561 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82466c18-4095-470b-a75e-4860239b4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.863260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82466c18-4095-470b-a75e-4860239b4140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.863526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82466c18-4095-470b-a75e-4860239b4140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:51.865815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82466c18-4095-470b-a75e-4860239b4140 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:51.881627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 917/1812] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:51 2022] DELETE /identity/v3/users/4e232ec8102e4f9a97c8030d35802585 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:51.885924 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa59f34-5e54-41bf-8b75-b8e82e431d1a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:51.886301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa59f34-5e54-41bf-8b75-b8e82e431d1a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:51.886657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa59f34-5e54-41bf-8b75-b8e82e431d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:51.908498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1aa59f34-5e54-41bf-8b75-b8e82e431d1a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:51.909989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1aa59f34-5e54-41bf-8b75-b8e82e431d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:51.911147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 896/1813] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:51 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:51.914567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82466c18-4095-470b-a75e-4860239b4140 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:51.916301 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-82466c18-4095-470b-a75e-4860239b4140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:51.992969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 918/1814] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:52.001253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa59f34-5e54-41bf-8b75-b8e82e431d1a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:52.002917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1aa59f34-5e54-41bf-8b75-b8e82e431d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:52.011615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82466c18-4095-470b-a75e-4860239b4140 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:52.017942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1bd11-c989-4f3f-b48e-2388702c4099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:52.018577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1bd11-c989-4f3f-b48e-2388702c4099 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.020855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1bd11-c989-4f3f-b48e-2388702c4099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.020855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1bd11-c989-4f3f-b48e-2388702c4099 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.020855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1bd11-c989-4f3f-b48e-2388702c4099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:52.021835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1bd11-c989-4f3f-b48e-2388702c4099 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:52.047392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:52.055317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 897/1815] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:51 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:52.057135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1bd11-c989-4f3f-b48e-2388702c4099 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:52.068221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1bd11-c989-4f3f-b48e-2388702c4099 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:52.077056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9111-7f3c-4eba-bec2-8af737270208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:52.077811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9111-7f3c-4eba-bec2-8af737270208 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.078180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9111-7f3c-4eba-bec2-8af737270208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.078542 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9111-7f3c-4eba-bec2-8af737270208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.079340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc9111-7f3c-4eba-bec2-8af737270208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:52.081036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc9111-7f3c-4eba-bec2-8af737270208 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:52.087987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa59f34-5e54-41bf-8b75-b8e82e431d1a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:52.091561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0e1d1-11a4-4a37-beae-b59a371ab692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:52.092181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0e1d1-11a4-4a37-beae-b59a371ab692 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.092450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0e1d1-11a4-4a37-beae-b59a371ab692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.092721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0e1d1-11a4-4a37-beae-b59a371ab692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.106088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0e1d1-11a4-4a37-beae-b59a371ab692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:52.107812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0e1d1-11a4-4a37-beae-b59a371ab692 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:52.110530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 898/1816] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:52.114590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9111-7f3c-4eba-bec2-8af737270208 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:52.126295 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 919/1817] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:52.128574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9111-7f3c-4eba-bec2-8af737270208 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:52.133777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbab47a-6b3d-44ea-8c2a-c58b132736c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:52.134739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbab47a-6b3d-44ea-8c2a-c58b132736c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.135190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbab47a-6b3d-44ea-8c2a-c58b132736c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.135608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbab47a-6b3d-44ea-8c2a-c58b132736c4 admin admin] PATH_INFO: `/v3/projects/f6120b1b21144f9ab125b3f439cfcef6/users/3a571df683c647c3b072a09d56a43586/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.153065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbab47a-6b3d-44ea-8c2a-c58b132736c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6120b1b21144f9ab125b3f439cfcef6, user_id=3a571df683c647c3b072a09d56a43586, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:52.156540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbab47a-6b3d-44ea-8c2a-c58b132736c4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:52.183430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 899/1818] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:52 2022] PUT /identity/v3/projects/f6120b1b21144f9ab125b3f439cfcef6/users/3a571df683c647c3b072a09d56a43586/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:52.187345 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0e1d1-11a4-4a37-beae-b59a371ab692 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:52.200158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0e1d1-11a4-4a37-beae-b59a371ab692 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:52.281384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854353d2-6a41-4c26-a07e-f50bc7fc24a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:52.283539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854353d2-6a41-4c26-a07e-f50bc7fc24a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.283912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854353d2-6a41-4c26-a07e-f50bc7fc24a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.284401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854353d2-6a41-4c26-a07e-f50bc7fc24a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.285148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854353d2-6a41-4c26-a07e-f50bc7fc24a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:52.286901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854353d2-6a41-4c26-a07e-f50bc7fc24a2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:52.301375 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 920/1819] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:52.305494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbab47a-6b3d-44ea-8c2a-c58b132736c4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:52.318238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbab47a-6b3d-44ea-8c2a-c58b132736c4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:52.340274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718df7a-158e-43bf-814f-b6d06ee27742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:52.341730 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718df7a-158e-43bf-814f-b6d06ee27742 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.343284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718df7a-158e-43bf-814f-b6d06ee27742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.344569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718df7a-158e-43bf-814f-b6d06ee27742 admin admin] PATH_INFO: `/v3/projects/f6120b1b21144f9ab125b3f439cfcef6/users/3a571df683c647c3b072a09d56a43586/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.347041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718df7a-158e-43bf-814f-b6d06ee27742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6120b1b21144f9ab125b3f439cfcef6, user_id=3a571df683c647c3b072a09d56a43586, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:52.350322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718df7a-158e-43bf-814f-b6d06ee27742 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:52.364862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 900/1820] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:52 2022] PUT /identity/v3/projects/f6120b1b21144f9ab125b3f439cfcef6/users/3a571df683c647c3b072a09d56a43586/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:52.381556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5f68-e838-4e32-9200-b9a9915fbb97 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.381770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5f68-e838-4e32-9200-b9a9915fbb97 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.382031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5f68-e838-4e32-9200-b9a9915fbb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.461431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9d1c5f68-e838-4e32-9200-b9a9915fbb97 None None] MFA Rules not processed for user `3a571df683c647c3b072a09d56a43586`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:52.462733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9d1c5f68-e838-4e32-9200-b9a9915fbb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:52.569257 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718df7a-158e-43bf-814f-b6d06ee27742 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:52.571659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b718df7a-158e-43bf-814f-b6d06ee27742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:52.635927 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:52.648314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 921/1821] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:52.662462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c5f68-e838-4e32-9200-b9a9915fbb97 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:52.664239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9d1c5f68-e838-4e32-9200-b9a9915fbb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:52.705264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718df7a-158e-43bf-814f-b6d06ee27742 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:52.726798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:52.727710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.728152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.728704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] PATH_INFO: `/v3/projects/d815e81ebfff424fadcc65fa010dee64` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.730081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d815e81ebfff424fadcc65fa010dee64)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:52.732834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:52.747511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c5f68-e838-4e32-9200-b9a9915fbb97 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:52.753754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e702b-3786-44fa-8100-20eab7aa1c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:52.755066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e702b-3786-44fa-8100-20eab7aa1c59 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.755066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e702b-3786-44fa-8100-20eab7aa1c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.755524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e702b-3786-44fa-8100-20eab7aa1c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.757793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-262e702b-3786-44fa-8100-20eab7aa1c59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:52.777604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:52.796405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd815e81ebfff424fadcc65fa010dee64', 'request_id': 'req-4c87fda3-b88d-445c-a018-c1a0960c487c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:52.804237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd815e81ebfff424fadcc65fa010dee64', 'request_id': 'req-4c87fda3-b88d-445c-a018-c1a0960c487c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:52.812673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd815e81ebfff424fadcc65fa010dee64', 'request_id': 'req-4c87fda3-b88d-445c-a018-c1a0960c487c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:52.832399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] The token cache is being invalidate because project d815e81ebfff424fadcc65fa010dee64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:52.833100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:52.834057 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:52.835926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 901/1822] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:52 2022] DELETE /identity/v3/projects/d815e81ebfff424fadcc65fa010dee64 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:52.840609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:52.843145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:52.864874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e702b-3786-44fa-8100-20eab7aa1c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:52.866809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e702b-3786-44fa-8100-20eab7aa1c59 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:52.880714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 922/1823] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:52.929744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87fda3-b88d-445c-a018-c1a0960c487c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:52.939958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:52.940667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:52.940941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:52.941204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] PATH_INFO: `/v3/users/9ca82c2ca5584011a21f66bdeade9331` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:52.943133 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca82c2ca5584011a21f66bdeade9331)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:52.945110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:53.042484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca82c2ca5584011a21f66bdeade9331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.043278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca82c2ca5584011a21f66bdeade9331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.052816 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca82c2ca5584011a21f66bdeade9331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.073783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:53.074716 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca82c2ca5584011a21f66bdeade9331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.076434 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca82c2ca5584011a21f66bdeade9331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.101169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 902/1824] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:52 2022] DELETE /identity/v3/users/9ca82c2ca5584011a21f66bdeade9331 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:53.507874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e702b-3786-44fa-8100-20eab7aa1c59 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:53.533907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e702b-3786-44fa-8100-20eab7aa1c59 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:53.630311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:53.630978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:53.631257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:53.631524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] PATH_INFO: `/v3/projects/377fd100e7b84799a35f1d425b346342` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:53.632937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=377fd100e7b84799a35f1d425b346342)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:53.635826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:53.703072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377fd100e7b84799a35f1d425b346342', 'request_id': 'req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.710149 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377fd100e7b84799a35f1d425b346342', 'request_id': 'req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.717674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377fd100e7b84799a35f1d425b346342', 'request_id': 'req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.734944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] The token cache is being invalidate because project 377fd100e7b84799a35f1d425b346342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:53.735232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.735903 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.737888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 923/1825] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:53 2022] DELETE /identity/v3/projects/377fd100e7b84799a35f1d425b346342 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:53.741972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:53.744166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:53.760066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103e4f8-afca-46b9-9426-d874a38f7d39 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:53.843212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:53.844063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:53.844435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:53.844801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] PATH_INFO: `/v3/users/be72d79f34754c2d9d7de964948fa6ad` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:53.846026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be72d79f34754c2d9d7de964948fa6ad)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:53.849800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:53.909813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be72d79f34754c2d9d7de964948fa6ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.910655 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be72d79f34754c2d9d7de964948fa6ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.920889 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be72d79f34754c2d9d7de964948fa6ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.936892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be72d79f34754c2d9d7de964948fa6ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.938696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be72d79f34754c2d9d7de964948fa6ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:53.957756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 903/1826] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:53 2022] DELETE /identity/v3/users/be72d79f34754c2d9d7de964948fa6ad => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:54.325456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:54.327709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:54.366631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1612f6a-6a58-4e62-adda-4e2ec9d150aa admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:54.459842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:54.467239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:54.469022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:54.494409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:54.495315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:54.495438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:54.495702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] PATH_INFO: `/v3/projects/f16f10e238964c7e8eb52a9f805ebdbf` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:54.498795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16f10e238964c7e8eb52a9f805ebdbf)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:54.499288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:54.553674 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebe0f5-5c90-407d-9298-1f55613a0d85 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:54.568531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:54.572102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16f10e238964c7e8eb52a9f805ebdbf', 'request_id': 'req-59f397ba-edc5-434d-8747-0f3a1223cb37'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:54.582200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16f10e238964c7e8eb52a9f805ebdbf', 'request_id': 'req-59f397ba-edc5-434d-8747-0f3a1223cb37'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:54.589770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16f10e238964c7e8eb52a9f805ebdbf', 'request_id': 'req-59f397ba-edc5-434d-8747-0f3a1223cb37'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:54.618950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] The token cache is being invalidate because project f16f10e238964c7e8eb52a9f805ebdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:54.619424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:54.620151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-59f397ba-edc5-434d-8747-0f3a1223cb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:54.623315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 924/1827] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:54 2022] DELETE /identity/v3/projects/f16f10e238964c7e8eb52a9f805ebdbf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:54.626518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0868ed-b3a6-4cf4-9395-e4f5237caabb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:54.627181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0868ed-b3a6-4cf4-9395-e4f5237caabb service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:54.627460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0868ed-b3a6-4cf4-9395-e4f5237caabb service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:54.627640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640815b1-4257-4252-b187-28b2d1613fb3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:54.627738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0868ed-b3a6-4cf4-9395-e4f5237caabb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:54.627929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640815b1-4257-4252-b187-28b2d1613fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:54.628274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640815b1-4257-4252-b187-28b2d1613fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:54.629476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6a0868ed-b3a6-4cf4-9395-e4f5237caabb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:54.650196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-640815b1-4257-4252-b187-28b2d1613fb3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:54.651300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-640815b1-4257-4252-b187-28b2d1613fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:54.712638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0868ed-b3a6-4cf4-9395-e4f5237caabb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:54.714482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0868ed-b3a6-4cf4-9395-e4f5237caabb service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:54.726966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 925/1828] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:54.731090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 904/1829] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:54.733653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d217dc-3d08-4a4b-8039-73aadc541c33 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:54.734099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d217dc-3d08-4a4b-8039-73aadc541c33 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:54.734368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d217dc-3d08-4a4b-8039-73aadc541c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:54.766336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-85d217dc-3d08-4a4b-8039-73aadc541c33 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:54.767594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-85d217dc-3d08-4a4b-8039-73aadc541c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:54.776117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 926/1830] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:54.788318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0868ed-b3a6-4cf4-9395-e4f5237caabb service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:54.818418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0868ed-b3a6-4cf4-9395-e4f5237caabb service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:54.835890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fb31-20d9-49cf-968e-69b7c5c8f880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:54.836807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fb31-20d9-49cf-968e-69b7c5c8f880 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:54.837082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fb31-20d9-49cf-968e-69b7c5c8f880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:54.837348 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fb31-20d9-49cf-968e-69b7c5c8f880 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:54.837994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8fb31-20d9-49cf-968e-69b7c5c8f880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:54.838351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8fb31-20d9-49cf-968e-69b7c5c8f880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:54.847146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8fb31-20d9-49cf-968e-69b7c5c8f880 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:54.875543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 905/1831] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:54.880436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d217dc-3d08-4a4b-8039-73aadc541c33 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:54.897427 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d217dc-3d08-4a4b-8039-73aadc541c33 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:54.920113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab790cf-c850-4ea7-bc3c-965417aa393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:54.920994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab790cf-c850-4ea7-bc3c-965417aa393e admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:54.921292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab790cf-c850-4ea7-bc3c-965417aa393e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:54.921552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab790cf-c850-4ea7-bc3c-965417aa393e admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:54.922196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab790cf-c850-4ea7-bc3c-965417aa393e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:54.924173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab790cf-c850-4ea7-bc3c-965417aa393e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:54.989941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 927/1832] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:54 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:54.994263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fb31-20d9-49cf-968e-69b7c5c8f880 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:55.009828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fb31-20d9-49cf-968e-69b7c5c8f880 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:55.099594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de39b0-959f-4622-be94-33cb98accb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:55.100293 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de39b0-959f-4622-be94-33cb98accb51 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:55.100653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de39b0-959f-4622-be94-33cb98accb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:55.100989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de39b0-959f-4622-be94-33cb98accb51 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:55.101709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de39b0-959f-4622-be94-33cb98accb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:55.103751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de39b0-959f-4622-be94-33cb98accb51 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:55.133630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 906/1833] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:54 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:55.138019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab790cf-c850-4ea7-bc3c-965417aa393e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:55.150485 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab790cf-c850-4ea7-bc3c-965417aa393e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:55.167647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913805-d92c-4813-9abc-2444719f79b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:55.168386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913805-d92c-4813-9abc-2444719f79b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:55.170742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913805-d92c-4813-9abc-2444719f79b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:55.170742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913805-d92c-4813-9abc-2444719f79b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:55.171762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97913805-d92c-4813-9abc-2444719f79b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:55.173837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97913805-d92c-4813-9abc-2444719f79b5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:55.189984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 928/1834] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:43:55.191636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de39b0-959f-4622-be94-33cb98accb51 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:55.202805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de39b0-959f-4622-be94-33cb98accb51 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:55.207892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdcf3e-ee71-4b03-988a-383a4cf4641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:55.208514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdcf3e-ee71-4b03-988a-383a4cf4641b admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:55.208784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdcf3e-ee71-4b03-988a-383a4cf4641b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:55.209053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdcf3e-ee71-4b03-988a-383a4cf4641b admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:55.209704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdcf3e-ee71-4b03-988a-383a4cf4641b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:55.211556 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdcf3e-ee71-4b03-988a-383a4cf4641b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:55.226538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 907/1835] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:55.227723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913805-d92c-4813-9abc-2444719f79b5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:55.238875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913805-d92c-4813-9abc-2444719f79b5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:55.244707 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901115bc-e18f-4077-9722-11774a44be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:55.245384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901115bc-e18f-4077-9722-11774a44be26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:55.245657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901115bc-e18f-4077-9722-11774a44be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:55.245928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901115bc-e18f-4077-9722-11774a44be26 admin admin] PATH_INFO: `/v3/projects/70f64cf669ba4d49ba428460b1d6f844/users/a9d5ac34c6a24e7d950c2f4b65c7ddfe/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:55.263870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901115bc-e18f-4077-9722-11774a44be26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f64cf669ba4d49ba428460b1d6f844, user_id=a9d5ac34c6a24e7d950c2f4b65c7ddfe, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:55.267121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901115bc-e18f-4077-9722-11774a44be26 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:55.286400 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 929/1836] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:55 2022] PUT /identity/v3/projects/70f64cf669ba4d49ba428460b1d6f844/users/a9d5ac34c6a24e7d950c2f4b65c7ddfe/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:55.298430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6278e4f-3d6c-441e-b90d-19cf4d0aa937 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:55.298767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6278e4f-3d6c-441e-b90d-19cf4d0aa937 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:55.299068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6278e4f-3d6c-441e-b90d-19cf4d0aa937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:55.330859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a6278e4f-3d6c-441e-b90d-19cf4d0aa937 None None] MFA Rules not processed for user `a9d5ac34c6a24e7d950c2f4b65c7ddfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:55.332139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a6278e4f-3d6c-441e-b90d-19cf4d0aa937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:55.353291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:55.413322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 908/1837] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:55.438349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901115bc-e18f-4077-9722-11774a44be26 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:55.441637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-901115bc-e18f-4077-9722-11774a44be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:55.450595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:55.556362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901115bc-e18f-4077-9722-11774a44be26 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:55.561450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5eb351-b7e5-421e-90de-2b14074787ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:55.562079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eb351-b7e5-421e-90de-2b14074787ce service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:55.562352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eb351-b7e5-421e-90de-2b14074787ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:55.562618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eb351-b7e5-421e-90de-2b14074787ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:55.572360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5eb351-b7e5-421e-90de-2b14074787ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:55.573945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5eb351-b7e5-421e-90de-2b14074787ce service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:55.589132 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 930/1838] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:55.590641 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6278e4f-3d6c-441e-b90d-19cf4d0aa937 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:55.594487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a6278e4f-3d6c-441e-b90d-19cf4d0aa937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:55.678470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6278e4f-3d6c-441e-b90d-19cf4d0aa937 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:55.684533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:55.685503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:55.686217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:55.687753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] PATH_INFO: `/v3/users/4c77b61662d44d93ad67deba2e453d82` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:55.689223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c77b61662d44d93ad67deba2e453d82)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:55.691360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:55.761743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c77b61662d44d93ad67deba2e453d82'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:55.762861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c77b61662d44d93ad67deba2e453d82'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:55.774830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c77b61662d44d93ad67deba2e453d82'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:55.794318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c77b61662d44d93ad67deba2e453d82'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:55.795403 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c77b61662d44d93ad67deba2e453d82'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:55.815612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 909/1839] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:55 2022] DELETE /identity/v3/users/4c77b61662d44d93ad67deba2e453d82 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:55.820595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37c42d-8c34-4a16-b9e5-d389789a7e23 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:55.820894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37c42d-8c34-4a16-b9e5-d389789a7e23 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:55.821155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37c42d-8c34-4a16-b9e5-d389789a7e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:55.849974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fe37c42d-8c34-4a16-b9e5-d389789a7e23 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:55.851457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fe37c42d-8c34-4a16-b9e5-d389789a7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:56.003940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 931/1840] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:56.018970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:56.018970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:56.169836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:56.188241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40ac4d-0f04-497b-9359-3f2133f46718 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:56.215918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ae173-8bc5-40fa-9b84-4ebe02f7ed14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:56.215918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ae173-8bc5-40fa-9b84-4ebe02f7ed14 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:56.215918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ae173-8bc5-40fa-9b84-4ebe02f7ed14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:56.215918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ae173-8bc5-40fa-9b84-4ebe02f7ed14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:56.234639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ae173-8bc5-40fa-9b84-4ebe02f7ed14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:56.237645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ae173-8bc5-40fa-9b84-4ebe02f7ed14 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:56.254518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 910/1841] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:43:56.667005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37c42d-8c34-4a16-b9e5-d389789a7e23 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:56.670648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fe37c42d-8c34-4a16-b9e5-d389789a7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:56.693976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37c42d-8c34-4a16-b9e5-d389789a7e23 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:56.700805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:56.701795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:56.702283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:56.702773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] PATH_INFO: `/v3/projects/c9c8a459458f418a8c0839ee522caa53` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:56.704344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c8a459458f418a8c0839ee522caa53)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:56.706873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:56.760720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c8a459458f418a8c0839ee522caa53', 'request_id': 'req-aa7a815e-24af-4377-ac79-591276b499e2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:56.768354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c8a459458f418a8c0839ee522caa53', 'request_id': 'req-aa7a815e-24af-4377-ac79-591276b499e2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:56.775612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c8a459458f418a8c0839ee522caa53', 'request_id': 'req-aa7a815e-24af-4377-ac79-591276b499e2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:56.799805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] The token cache is being invalidate because project c9c8a459458f418a8c0839ee522caa53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:56.800319 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:56.803170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-aa7a815e-24af-4377-ac79-591276b499e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:56.806090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 932/1842] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:56 2022] DELETE /identity/v3/projects/c9c8a459458f418a8c0839ee522caa53 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:56.811858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bacb7-d81a-4dff-848e-e501ed6e8d21 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:56.812232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bacb7-d81a-4dff-848e-e501ed6e8d21 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:56.812507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bacb7-d81a-4dff-848e-e501ed6e8d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:56.834045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e05bacb7-d81a-4dff-848e-e501ed6e8d21 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:56.835326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e05bacb7-d81a-4dff-848e-e501ed6e8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:56.906162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 911/1843] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:56.915181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70e5af-848c-4eb3-963b-f899d53cc569 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:56.915471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70e5af-848c-4eb3-963b-f899d53cc569 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:56.915742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70e5af-848c-4eb3-963b-f899d53cc569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:56.939168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0e70e5af-848c-4eb3-963b-f899d53cc569 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:56.940593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0e70e5af-848c-4eb3-963b-f899d53cc569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:56.951043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 933/1844] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:56.955361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bacb7-d81a-4dff-848e-e501ed6e8d21 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:56.968846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bacb7-d81a-4dff-848e-e501ed6e8d21 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:56.974604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e502de-37a6-4530-a688-f38ba39c8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:56.975450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e502de-37a6-4530-a688-f38ba39c8859 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:56.975742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e502de-37a6-4530-a688-f38ba39c8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:56.976078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e502de-37a6-4530-a688-f38ba39c8859 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:56.976852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e502de-37a6-4530-a688-f38ba39c8859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:43:56.977189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e502de-37a6-4530-a688-f38ba39c8859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:56.978730 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e502de-37a6-4530-a688-f38ba39c8859 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:56.990576 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72c39-301f-4f45-8249-7bd89b264f02 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:56.990853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72c39-301f-4f45-8249-7bd89b264f02 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:56.991154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72c39-301f-4f45-8249-7bd89b264f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:56.994965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 912/1845] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:43:56.997848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e502de-37a6-4530-a688-f38ba39c8859 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:57.007496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e502de-37a6-4530-a688-f38ba39c8859 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:57.010036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-60c72c39-301f-4f45-8249-7bd89b264f02 None None] MFA Rules not processed for user `3851579d7f034722a0b0975fd38e049d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:57.011250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-60c72c39-301f-4f45-8249-7bd89b264f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:57.012060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b2a63-d3bc-4093-b27d-d36ee3d800ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:57.012678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b2a63-d3bc-4093-b27d-d36ee3d800ad admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:57.012949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b2a63-d3bc-4093-b27d-d36ee3d800ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:57.013269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b2a63-d3bc-4093-b27d-d36ee3d800ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:57.013863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b2a63-d3bc-4093-b27d-d36ee3d800ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:57.016162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b2a63-d3bc-4093-b27d-d36ee3d800ad admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:57.032587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:57.048717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 913/1846] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:43:56 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:43:57.053500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b2a63-d3bc-4093-b27d-d36ee3d800ad admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:57.082654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 934/1847] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:57.137018 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b2a63-d3bc-4093-b27d-d36ee3d800ad admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:57.142438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fdfca-bea8-474b-89af-2352f219a1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:57.143113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fdfca-bea8-474b-89af-2352f219a1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:57.143393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fdfca-bea8-474b-89af-2352f219a1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:57.143663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fdfca-bea8-474b-89af-2352f219a1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:57.144297 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fdfca-bea8-474b-89af-2352f219a1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:57.146209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fdfca-bea8-474b-89af-2352f219a1b9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:57.171827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 914/1848] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:43:57 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:43:57.175946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72c39-301f-4f45-8249-7bd89b264f02 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:57.192002 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72c39-301f-4f45-8249-7bd89b264f02 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:57.197047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107209cc-8a53-4b78-95e4-089f923e6e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:57.197744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107209cc-8a53-4b78-95e4-089f923e6e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:57.198090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107209cc-8a53-4b78-95e4-089f923e6e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:57.198431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107209cc-8a53-4b78-95e4-089f923e6e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:57.199197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107209cc-8a53-4b78-95e4-089f923e6e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:57.201929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107209cc-8a53-4b78-95e4-089f923e6e22 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:57.216558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 935/1849] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:57.218055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fdfca-bea8-474b-89af-2352f219a1b9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:57.228856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fdfca-bea8-474b-89af-2352f219a1b9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:57.234510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13d8af-cad1-465f-a166-8dbd9922f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:57.235158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13d8af-cad1-465f-a166-8dbd9922f3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:57.235431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13d8af-cad1-465f-a166-8dbd9922f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:57.235693 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13d8af-cad1-465f-a166-8dbd9922f3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:57.236332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13d8af-cad1-465f-a166-8dbd9922f3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:57.238092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13d8af-cad1-465f-a166-8dbd9922f3c4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:57.251969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 915/1850] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:43:57.253232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107209cc-8a53-4b78-95e4-089f923e6e22 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:57.268772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107209cc-8a53-4b78-95e4-089f923e6e22 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:57.281365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a415e07-9b7d-4fed-adac-e252bb148819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:57.282083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a415e07-9b7d-4fed-adac-e252bb148819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:57.282309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a415e07-9b7d-4fed-adac-e252bb148819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:57.282579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a415e07-9b7d-4fed-adac-e252bb148819 admin admin] PATH_INFO: `/v3/projects/f0e2432d95414c9b9186dafcb5a94a98/users/4fb5ff0d31f6499db6b1dc73e458ea14/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:57.303141 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a415e07-9b7d-4fed-adac-e252bb148819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e2432d95414c9b9186dafcb5a94a98, user_id=4fb5ff0d31f6499db6b1dc73e458ea14, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:57.307624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a415e07-9b7d-4fed-adac-e252bb148819 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:57.323454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 936/1851] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:43:57 2022] PUT /identity/v3/projects/f0e2432d95414c9b9186dafcb5a94a98/users/4fb5ff0d31f6499db6b1dc73e458ea14/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:57.335146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7e836-66dc-4059-9d47-8e571eade275 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:57.335443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7e836-66dc-4059-9d47-8e571eade275 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:57.335688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7e836-66dc-4059-9d47-8e571eade275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:57.366304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-73b7e836-66dc-4059-9d47-8e571eade275 None None] MFA Rules not processed for user `4fb5ff0d31f6499db6b1dc73e458ea14`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:57.367571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-73b7e836-66dc-4059-9d47-8e571eade275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:57.390842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:57.444529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 916/1852] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:57.455584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a415e07-9b7d-4fed-adac-e252bb148819 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:57.457431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4a415e07-9b7d-4fed-adac-e252bb148819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:57.539553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a415e07-9b7d-4fed-adac-e252bb148819 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:57.543890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65be1d-792c-41d6-b364-a98f822d7677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:57.544686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65be1d-792c-41d6-b364-a98f822d7677 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:57.545028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65be1d-792c-41d6-b364-a98f822d7677 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:57.545388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65be1d-792c-41d6-b364-a98f822d7677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:57.560150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65be1d-792c-41d6-b364-a98f822d7677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:57.562819 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65be1d-792c-41d6-b364-a98f822d7677 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:57.579699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 937/1853] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:58.942276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7e836-66dc-4059-9d47-8e571eade275 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:58.943850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-73b7e836-66dc-4059-9d47-8e571eade275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:59.014331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7e836-66dc-4059-9d47-8e571eade275 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:59.018825 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:59.019424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:59.019695 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:59.019957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] PATH_INFO: `/v3/users/b1a2cf2eed3e40ecad40ccf79a5d177a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:59.021088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a2cf2eed3e40ecad40ccf79a5d177a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:59.023043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:59.075497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a2cf2eed3e40ecad40ccf79a5d177a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.076135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a2cf2eed3e40ecad40ccf79a5d177a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.083797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a2cf2eed3e40ecad40ccf79a5d177a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.096011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a2cf2eed3e40ecad40ccf79a5d177a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.096908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c2e83d80-529f-4f10-a0b3-e059b3d9bafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a2cf2eed3e40ecad40ccf79a5d177a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.114812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 917/1854] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:58 2022] DELETE /identity/v3/users/b1a2cf2eed3e40ecad40ccf79a5d177a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:59.119359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532441e-2e94-43c8-b9b3-86f03261b655 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:59.119713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532441e-2e94-43c8-b9b3-86f03261b655 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:59.119924 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532441e-2e94-43c8-b9b3-86f03261b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:59.139378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2532441e-2e94-43c8-b9b3-86f03261b655 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:59.140832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2532441e-2e94-43c8-b9b3-86f03261b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:59.168159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8c485-8a3f-4a91-8488-221052e5149a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:59.168435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8c485-8a3f-4a91-8488-221052e5149a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:59.168707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8c485-8a3f-4a91-8488-221052e5149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:59.189051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4fd8c485-8a3f-4a91-8488-221052e5149a None None] MFA Rules not processed for user `4fb5ff0d31f6499db6b1dc73e458ea14`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:43:59.190293 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4fd8c485-8a3f-4a91-8488-221052e5149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:59.211085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 938/1855] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:43:59.222199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532441e-2e94-43c8-b9b3-86f03261b655 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:59.223633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2532441e-2e94-43c8-b9b3-86f03261b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:59.232660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:59.258061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 918/1856] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:43:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:43:59.268644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:59.284947 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532441e-2e94-43c8-b9b3-86f03261b655 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:59.288697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af3a4d-f7ea-41fe-befa-0a233851d575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:59.289307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af3a4d-f7ea-41fe-befa-0a233851d575 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:59.289578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af3a4d-f7ea-41fe-befa-0a233851d575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:59.289849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af3a4d-f7ea-41fe-befa-0a233851d575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:59.299348 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af3a4d-f7ea-41fe-befa-0a233851d575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:59.300785 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af3a4d-f7ea-41fe-befa-0a233851d575 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:59.310231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 939/1857] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:43:59.602887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8c485-8a3f-4a91-8488-221052e5149a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:59.604324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4fd8c485-8a3f-4a91-8488-221052e5149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:43:59.618698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8c485-8a3f-4a91-8488-221052e5149a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:59.623261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:59.623888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:59.624158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:59.628483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] PATH_INFO: `/v3/projects/82f3a47bb2d642118ee8f7fce8a24bf6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:59.629686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f3a47bb2d642118ee8f7fce8a24bf6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:59.631961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:59.692713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f3a47bb2d642118ee8f7fce8a24bf6', 'request_id': 'req-8ef531aa-8c8f-4c25-b441-36532312ee15'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.699214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f3a47bb2d642118ee8f7fce8a24bf6', 'request_id': 'req-8ef531aa-8c8f-4c25-b441-36532312ee15'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.705318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f3a47bb2d642118ee8f7fce8a24bf6', 'request_id': 'req-8ef531aa-8c8f-4c25-b441-36532312ee15'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.723321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] The token cache is being invalidate because project 82f3a47bb2d642118ee8f7fce8a24bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:43:59.723872 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.725111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.729875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 919/1858] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:43:59 2022] DELETE /identity/v3/projects/82f3a47bb2d642118ee8f7fce8a24bf6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:43:59.730895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af3a4d-f7ea-41fe-befa-0a233851d575 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:43:59.742242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af3a4d-f7ea-41fe-befa-0a233851d575 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:43:59.839537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:43:59.840296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:43:59.840600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:43:59.840961 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] PATH_INFO: `/v3/users/3a571df683c647c3b072a09d56a43586` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:43:59.842150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a571df683c647c3b072a09d56a43586)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:43:59.844471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:43:59.898011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a571df683c647c3b072a09d56a43586'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.898660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a571df683c647c3b072a09d56a43586'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.906293 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a571df683c647c3b072a09d56a43586'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.918236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a571df683c647c3b072a09d56a43586'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.918966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-56a1f996-95c4-43a1-ba1d-8ec3ab1d53a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a571df683c647c3b072a09d56a43586'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:43:59.933514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 940/1859] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:43:59 2022] DELETE /identity/v3/users/3a571df683c647c3b072a09d56a43586 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:00.247850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:00.250134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:00.266215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef531aa-8c8f-4c25-b441-36532312ee15 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:00.339012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:00.339610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.339892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.340161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] PATH_INFO: `/v3/projects/f6120b1b21144f9ab125b3f439cfcef6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.341288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6120b1b21144f9ab125b3f439cfcef6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:00.343396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:00.397698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6120b1b21144f9ab125b3f439cfcef6', 'request_id': 'req-cca58532-2245-492a-b0da-51a39ea67c80'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:00.403982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6120b1b21144f9ab125b3f439cfcef6', 'request_id': 'req-cca58532-2245-492a-b0da-51a39ea67c80'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:00.409724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6120b1b21144f9ab125b3f439cfcef6', 'request_id': 'req-cca58532-2245-492a-b0da-51a39ea67c80'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:00.413594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:00.429299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] The token cache is being invalidate because project f6120b1b21144f9ab125b3f439cfcef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:00.429757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:00.430384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cca58532-2245-492a-b0da-51a39ea67c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:00.431926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 920/1860] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:00 2022] DELETE /identity/v3/projects/f6120b1b21144f9ab125b3f439cfcef6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:00.436963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037caa0-33a0-422a-aeca-0c09b83048bd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.437445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037caa0-33a0-422a-aeca-0c09b83048bd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.437551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037caa0-33a0-422a-aeca-0c09b83048bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.456869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f037caa0-33a0-422a-aeca-0c09b83048bd None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:00.458070 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f037caa0-33a0-422a-aeca-0c09b83048bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:00.508288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:00.520600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 941/1861] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:00.530615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e66cda-74e5-44c8-83ce-4bae909173a4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.531109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e66cda-74e5-44c8-83ce-4bae909173a4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.531585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e66cda-74e5-44c8-83ce-4bae909173a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.553884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-33e66cda-74e5-44c8-83ce-4bae909173a4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:00.555124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-33e66cda-74e5-44c8-83ce-4bae909173a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:00.568855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 921/1862] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:00.570075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037caa0-33a0-422a-aeca-0c09b83048bd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:00.580661 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037caa0-33a0-422a-aeca-0c09b83048bd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:00.586717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1373-bc29-40c5-939a-3d16a3081a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:00.587361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1373-bc29-40c5-939a-3d16a3081a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.587636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1373-bc29-40c5-939a-3d16a3081a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.588015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1373-bc29-40c5-939a-3d16a3081a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.588526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1373-bc29-40c5-939a-3d16a3081a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:44:00.588837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1373-bc29-40c5-939a-3d16a3081a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:00.590513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1373-bc29-40c5-939a-3d16a3081a47 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:00.604510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 942/1863] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:44:00.609153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e66cda-74e5-44c8-83ce-4bae909173a4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:00.618604 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e66cda-74e5-44c8-83ce-4bae909173a4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:00.623405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e98a9-f31e-4650-931e-3715b34b525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:00.624032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e98a9-f31e-4650-931e-3715b34b525f admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.624454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e98a9-f31e-4650-931e-3715b34b525f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.625287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e98a9-f31e-4650-931e-3715b34b525f admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.626006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e98a9-f31e-4650-931e-3715b34b525f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:00.628014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e98a9-f31e-4650-931e-3715b34b525f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:00.663682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 922/1864] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:00 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:44:00.665010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1373-bc29-40c5-939a-3d16a3081a47 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:00.676418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1373-bc29-40c5-939a-3d16a3081a47 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:00.737342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bbf06-bad8-4448-8c13-7cd2f3d834a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:00.737948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bbf06-bad8-4448-8c13-7cd2f3d834a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.738222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bbf06-bad8-4448-8c13-7cd2f3d834a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.738489 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bbf06-bad8-4448-8c13-7cd2f3d834a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.739144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bbf06-bad8-4448-8c13-7cd2f3d834a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:00.741063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bbf06-bad8-4448-8c13-7cd2f3d834a6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:00.767261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 943/1865] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:00 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:00.771483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e98a9-f31e-4650-931e-3715b34b525f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:00.781944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e98a9-f31e-4650-931e-3715b34b525f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:00.787197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0776230-2516-461f-9a22-a3e22aee35b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:00.787789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0776230-2516-461f-9a22-a3e22aee35b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.788059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0776230-2516-461f-9a22-a3e22aee35b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.788460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0776230-2516-461f-9a22-a3e22aee35b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.789094 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0776230-2516-461f-9a22-a3e22aee35b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:00.790736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0776230-2516-461f-9a22-a3e22aee35b9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:00.801055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 923/1866] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:00.805150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bbf06-bad8-4448-8c13-7cd2f3d834a6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:00.815943 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bbf06-bad8-4448-8c13-7cd2f3d834a6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:00.821547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc9bfd-2409-45d7-9166-679d64c63776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:00.822112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc9bfd-2409-45d7-9166-679d64c63776 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.822371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc9bfd-2409-45d7-9166-679d64c63776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.822936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc9bfd-2409-45d7-9166-679d64c63776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.823342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc9bfd-2409-45d7-9166-679d64c63776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:00.824965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc9bfd-2409-45d7-9166-679d64c63776 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:00.836517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 944/1867] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:00.841143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0776230-2516-461f-9a22-a3e22aee35b9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:00.853827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0776230-2516-461f-9a22-a3e22aee35b9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:00.858850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de358fb-bd4b-4270-8065-49822d55fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:00.859458 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de358fb-bd4b-4270-8065-49822d55fd02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.859737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de358fb-bd4b-4270-8065-49822d55fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.860010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de358fb-bd4b-4270-8065-49822d55fd02 admin admin] PATH_INFO: `/v3/projects/928bbc391bbe43cd98046d34e08159d5/users/cf79a9a9ef714eaf9c476efa850d88bd/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.875987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de358fb-bd4b-4270-8065-49822d55fd02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928bbc391bbe43cd98046d34e08159d5, user_id=cf79a9a9ef714eaf9c476efa850d88bd, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:00.878856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de358fb-bd4b-4270-8065-49822d55fd02 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:00.901030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 924/1868] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:00 2022] PUT /identity/v3/projects/928bbc391bbe43cd98046d34e08159d5/users/cf79a9a9ef714eaf9c476efa850d88bd/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:00.911956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238def6-d4ce-4d55-a696-0cd5ea6a4982 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:00.912249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238def6-d4ce-4d55-a696-0cd5ea6a4982 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:00.912631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238def6-d4ce-4d55-a696-0cd5ea6a4982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:00.944129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f238def6-d4ce-4d55-a696-0cd5ea6a4982 None None] MFA Rules not processed for user `cf79a9a9ef714eaf9c476efa850d88bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:00.945444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f238def6-d4ce-4d55-a696-0cd5ea6a4982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:01.015546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 945/1869] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:01.020088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de358fb-bd4b-4270-8065-49822d55fd02 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:01.084126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de358fb-bd4b-4270-8065-49822d55fd02 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:01.096215 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064edc3a-b182-4a70-8db3-9339c58de86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:01.097115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064edc3a-b182-4a70-8db3-9339c58de86e admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:01.097437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064edc3a-b182-4a70-8db3-9339c58de86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:01.097846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064edc3a-b182-4a70-8db3-9339c58de86e admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:01.098971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064edc3a-b182-4a70-8db3-9339c58de86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:01.101493 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064edc3a-b182-4a70-8db3-9339c58de86e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:01.145698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 925/1870] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:01 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:01.149549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238def6-d4ce-4d55-a696-0cd5ea6a4982 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:01.166474 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238def6-d4ce-4d55-a696-0cd5ea6a4982 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:01.268672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:01.276715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a89653-90ed-48d7-919a-84e2e2ee3385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:01.277341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a89653-90ed-48d7-919a-84e2e2ee3385 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:01.277910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a89653-90ed-48d7-919a-84e2e2ee3385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:01.278355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a89653-90ed-48d7-919a-84e2e2ee3385 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:01.279421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a89653-90ed-48d7-919a-84e2e2ee3385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:01.281454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a89653-90ed-48d7-919a-84e2e2ee3385 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:01.304737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 946/1871] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:01 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:44:01.308580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064edc3a-b182-4a70-8db3-9339c58de86e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:01.319433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064edc3a-b182-4a70-8db3-9339c58de86e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:01.327713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6e40-ed76-4e74-9c21-d843a475ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:01.328332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6e40-ed76-4e74-9c21-d843a475ffce admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:01.328606 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6e40-ed76-4e74-9c21-d843a475ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:01.328873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6e40-ed76-4e74-9c21-d843a475ffce admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:01.329522 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b6e40-ed76-4e74-9c21-d843a475ffce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:01.331162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b6e40-ed76-4e74-9c21-d843a475ffce admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:01.342907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 926/1872] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:01.347265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a89653-90ed-48d7-919a-84e2e2ee3385 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:01.358905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a89653-90ed-48d7-919a-84e2e2ee3385 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:01.364281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643603ae-6b15-4271-920c-4e7601e8cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:01.365007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643603ae-6b15-4271-920c-4e7601e8cd5f admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:01.365634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643603ae-6b15-4271-920c-4e7601e8cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:01.367117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643603ae-6b15-4271-920c-4e7601e8cd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:01.367897 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643603ae-6b15-4271-920c-4e7601e8cd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:01.369585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643603ae-6b15-4271-920c-4e7601e8cd5f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:01.383579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 947/1873] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:01.386380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6e40-ed76-4e74-9c21-d843a475ffce admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:01.398711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6e40-ed76-4e74-9c21-d843a475ffce admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:01.404332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51458ff-0fe8-4a80-8c0a-e1752f4fdf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:01.405058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51458ff-0fe8-4a80-8c0a-e1752f4fdf11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:01.405623 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51458ff-0fe8-4a80-8c0a-e1752f4fdf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:01.406082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51458ff-0fe8-4a80-8c0a-e1752f4fdf11 admin admin] PATH_INFO: `/v3/projects/38067247ef0742558cbcfdc14ee7384f/users/2500c6e9461d44959c9b02a12316112e/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:01.422150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51458ff-0fe8-4a80-8c0a-e1752f4fdf11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38067247ef0742558cbcfdc14ee7384f, user_id=2500c6e9461d44959c9b02a12316112e, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:01.424802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51458ff-0fe8-4a80-8c0a-e1752f4fdf11 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:01.440794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 927/1874] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:01 2022] PUT /identity/v3/projects/38067247ef0742558cbcfdc14ee7384f/users/2500c6e9461d44959c9b02a12316112e/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:01.451952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b038c-e6d3-446b-a808-6172f72dd6f8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:01.452411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b038c-e6d3-446b-a808-6172f72dd6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:01.452411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b038c-e6d3-446b-a808-6172f72dd6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:01.481958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8c1b038c-e6d3-446b-a808-6172f72dd6f8 None None] MFA Rules not processed for user `2500c6e9461d44959c9b02a12316112e`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:01.483411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8c1b038c-e6d3-446b-a808-6172f72dd6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:01.600381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 948/1875] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:01.605431 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51458ff-0fe8-4a80-8c0a-e1752f4fdf11 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:01.689050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:01.707954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51458ff-0fe8-4a80-8c0a-e1752f4fdf11 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:01.713104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f13e3-c593-4527-8b2c-77db0a523671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:01.713868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f13e3-c593-4527-8b2c-77db0a523671 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:01.714137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f13e3-c593-4527-8b2c-77db0a523671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:01.714400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f13e3-c593-4527-8b2c-77db0a523671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:01.715141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f13e3-c593-4527-8b2c-77db0a523671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:01.717079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f13e3-c593-4527-8b2c-77db0a523671 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:01.813830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 928/1876] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:01 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:44:01.819110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b038c-e6d3-446b-a808-6172f72dd6f8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:01.835475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b038c-e6d3-446b-a808-6172f72dd6f8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:01.915426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073dbd6-ab75-4282-95c2-aa22f6559226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:01.915899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073dbd6-ab75-4282-95c2-aa22f6559226 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:01.916174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073dbd6-ab75-4282-95c2-aa22f6559226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:01.916446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073dbd6-ab75-4282-95c2-aa22f6559226 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:01.917099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073dbd6-ab75-4282-95c2-aa22f6559226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:01.919059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073dbd6-ab75-4282-95c2-aa22f6559226 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:01.944032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 949/1877] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:01 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:01.948167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f13e3-c593-4527-8b2c-77db0a523671 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:01.974779 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f13e3-c593-4527-8b2c-77db0a523671 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:01.989975 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ee439-a8e0-4eba-bb4b-19cf1cddeff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:01.991086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ee439-a8e0-4eba-bb4b-19cf1cddeff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:01.991662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ee439-a8e0-4eba-bb4b-19cf1cddeff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:01.992034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ee439-a8e0-4eba-bb4b-19cf1cddeff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:01.992751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ee439-a8e0-4eba-bb4b-19cf1cddeff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:01.994445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ee439-a8e0-4eba-bb4b-19cf1cddeff3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:02.020811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 929/1878] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:02.022069 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073dbd6-ab75-4282-95c2-aa22f6559226 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:02.033980 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073dbd6-ab75-4282-95c2-aa22f6559226 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:02.039067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a2e2c-ecc5-4e45-a3bb-b5192f918474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:02.039638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2e2c-ecc5-4e45-a3bb-b5192f918474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:02.039919 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2e2c-ecc5-4e45-a3bb-b5192f918474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:02.040191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2e2c-ecc5-4e45-a3bb-b5192f918474 admin admin] PATH_INFO: `/v3/projects/88b4b19de760457e90daf94696120fe8/users/dce81d0db54a4fc6b49107593d9de226/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:02.056276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a2e2c-ecc5-4e45-a3bb-b5192f918474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b4b19de760457e90daf94696120fe8, user_id=dce81d0db54a4fc6b49107593d9de226, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:02.058980 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a2e2c-ecc5-4e45-a3bb-b5192f918474 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:02.080944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 950/1879] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:02 2022] PUT /identity/v3/projects/88b4b19de760457e90daf94696120fe8/users/dce81d0db54a4fc6b49107593d9de226/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:02.084886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ee439-a8e0-4eba-bb4b-19cf1cddeff3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:02.096846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ee439-a8e0-4eba-bb4b-19cf1cddeff3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:02.168787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af12d6d-a659-402b-8a27-d2edaa2990b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:02.169549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af12d6d-a659-402b-8a27-d2edaa2990b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:02.169843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af12d6d-a659-402b-8a27-d2edaa2990b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:02.170591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af12d6d-a659-402b-8a27-d2edaa2990b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:02.171299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af12d6d-a659-402b-8a27-d2edaa2990b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:02.174485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af12d6d-a659-402b-8a27-d2edaa2990b9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:02.194272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 930/1880] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:02.195445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a2e2c-ecc5-4e45-a3bb-b5192f918474 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:02.210973 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631c3a-c901-4481-94d1-f9f231d1dfa4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:02.211238 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631c3a-c901-4481-94d1-f9f231d1dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:02.211519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631c3a-c901-4481-94d1-f9f231d1dfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:02.215989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a2e2c-ecc5-4e45-a3bb-b5192f918474 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:02.227752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c9bdf-c264-4855-acc8-29bc39f718e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:02.228443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c9bdf-c264-4855-acc8-29bc39f718e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:02.228743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c9bdf-c264-4855-acc8-29bc39f718e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:02.228991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c9bdf-c264-4855-acc8-29bc39f718e3 admin admin] PATH_INFO: `/v3/projects/88b4b19de760457e90daf94696120fe8/users/dce81d0db54a4fc6b49107593d9de226/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:02.233946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c9bdf-c264-4855-acc8-29bc39f718e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b4b19de760457e90daf94696120fe8, user_id=dce81d0db54a4fc6b49107593d9de226, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:02.236669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c9bdf-c264-4855-acc8-29bc39f718e3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:02.252195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4f631c3a-c901-4481-94d1-f9f231d1dfa4 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:02.253526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4f631c3a-c901-4481-94d1-f9f231d1dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:02.261129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 951/1881] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:02 2022] PUT /identity/v3/projects/88b4b19de760457e90daf94696120fe8/users/dce81d0db54a4fc6b49107593d9de226/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:02.274305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9e1a4-e239-4f50-91f2-86db50241436 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:02.274767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9e1a4-e239-4f50-91f2-86db50241436 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:02.275073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9e1a4-e239-4f50-91f2-86db50241436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:02.336678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 931/1882] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:44:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:02.346113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f631c3a-c901-4481-94d1-f9f231d1dfa4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:02.348626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0de9e1a4-e239-4f50-91f2-86db50241436 None None] MFA Rules not processed for user `dce81d0db54a4fc6b49107593d9de226`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:02.350410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0de9e1a4-e239-4f50-91f2-86db50241436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:02.351027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4f631c3a-c901-4481-94d1-f9f231d1dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:02.355749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:02.460219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 952/1883] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:44:02.472749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9e1a4-e239-4f50-91f2-86db50241436 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:02.474907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0de9e1a4-e239-4f50-91f2-86db50241436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:02.516030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:02.554727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f631c3a-c901-4481-94d1-f9f231d1dfa4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:02.572264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8913ed-68ab-4225-b45b-315661e701ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:02.575703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8913ed-68ab-4225-b45b-315661e701ea service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:02.576213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8913ed-68ab-4225-b45b-315661e701ea service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:02.576563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8913ed-68ab-4225-b45b-315661e701ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:02.592595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8913ed-68ab-4225-b45b-315661e701ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:02.596758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8913ed-68ab-4225-b45b-315661e701ea service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:02.601785 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9e1a4-e239-4f50-91f2-86db50241436 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:02.607616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9fc45-5f74-451e-b6f2-8c0be9032172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:02.608955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9fc45-5f74-451e-b6f2-8c0be9032172 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:02.609298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9fc45-5f74-451e-b6f2-8c0be9032172 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:02.609637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9fc45-5f74-451e-b6f2-8c0be9032172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:02.620992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9fc45-5f74-451e-b6f2-8c0be9032172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:02.623460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9fc45-5f74-451e-b6f2-8c0be9032172 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:02.643309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 932/1884] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:44:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:44:02.659201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 953/1885] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:44:02.730824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8913ed-68ab-4225-b45b-315661e701ea service swift] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:02.733438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ed8913ed-68ab-4225-b45b-315661e701ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:02.753312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8913ed-68ab-4225-b45b-315661e701ea service swift] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:02.763730 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5548-3e85-4682-ae38-28af65cfb113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:02.764836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5548-3e85-4682-ae38-28af65cfb113 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:02.767420 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5548-3e85-4682-ae38-28af65cfb113 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:02.767798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5548-3e85-4682-ae38-28af65cfb113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:02.919875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c5548-3e85-4682-ae38-28af65cfb113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:02.921904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c5548-3e85-4682-ae38-28af65cfb113 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:02.968674 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 933/1886] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:04.995232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8a85-e987-402c-b075-ae49751f550a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:04.995703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8a85-e987-402c-b075-ae49751f550a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:04.995779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8a85-e987-402c-b075-ae49751f550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:05.043390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-399e8a85-e987-402c-b075-ae49751f550a None None] MFA Rules not processed for user `59706abd14944c648378688abaac199d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:05.044703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-399e8a85-e987-402c-b075-ae49751f550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:05.132603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 954/1887] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:06.471783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5548-3e85-4682-ae38-28af65cfb113 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:06.473529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-761c5548-3e85-4682-ae38-28af65cfb113 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:06.551572 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5548-3e85-4682-ae38-28af65cfb113 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:06.557651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8a85-e987-402c-b075-ae49751f550a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:06.567801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:06.568643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:06.569062 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:06.569428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] PATH_INFO: `/v3/users/a9d5ac34c6a24e7d950c2f4b65c7ddfe` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:06.570163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8a85-e987-402c-b075-ae49751f550a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:06.571181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d5ac34c6a24e7d950c2f4b65c7ddfe)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:06.573513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:06.574784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:06.575449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:06.575721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:06.575987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] PATH_INFO: `/v3/users/cf79a9a9ef714eaf9c476efa850d88bd` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:06.577090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf79a9a9ef714eaf9c476efa850d88bd)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:06.579148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:06.645541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d5ac34c6a24e7d950c2f4b65c7ddfe'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.646196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d5ac34c6a24e7d950c2f4b65c7ddfe'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.647827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:06.650719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf79a9a9ef714eaf9c476efa850d88bd'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.651418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf79a9a9ef714eaf9c476efa850d88bd'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.653937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d5ac34c6a24e7d950c2f4b65c7ddfe'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.659793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf79a9a9ef714eaf9c476efa850d88bd'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.672938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d5ac34c6a24e7d950c2f4b65c7ddfe'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.674633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-58ff7bed-c393-478f-b67e-e2baa0a63ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d5ac34c6a24e7d950c2f4b65c7ddfe'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.681422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf79a9a9ef714eaf9c476efa850d88bd'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.682288 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff837a0f-d7d7-459b-b9b5-46a191f5b5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf79a9a9ef714eaf9c476efa850d88bd'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:06.699210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 934/1888] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:06 2022] DELETE /identity/v3/users/a9d5ac34c6a24e7d950c2f4b65c7ddfe => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:06.704054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc174c-153a-43f3-bb92-9884d4d657f4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:06.704524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc174c-153a-43f3-bb92-9884d4d657f4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:06.704976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc174c-153a-43f3-bb92-9884d4d657f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:06.712145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 955/1889] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:06 2022] DELETE /identity/v3/users/cf79a9a9ef714eaf9c476efa850d88bd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:44:06.715634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:06.716659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11624808-ab04-4d25-b0e4-42373cfa3542 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:06.717029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11624808-ab04-4d25-b0e4-42373cfa3542 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:06.717377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11624808-ab04-4d25-b0e4-42373cfa3542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:06.742000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4fdc174c-153a-43f3-bb92-9884d4d657f4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:06.743250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4fdc174c-153a-43f3-bb92-9884d4d657f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:06.747990 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-11624808-ab04-4d25-b0e4-42373cfa3542 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:06.750453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-11624808-ab04-4d25-b0e4-42373cfa3542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:06.838308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 956/1890] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:06.838819 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 935/1891] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:06.850304 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11624808-ab04-4d25-b0e4-42373cfa3542 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:06.851799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-11624808-ab04-4d25-b0e4-42373cfa3542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:06.853370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc174c-153a-43f3-bb92-9884d4d657f4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:06.854738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4fdc174c-153a-43f3-bb92-9884d4d657f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:06.920689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11624808-ab04-4d25-b0e4-42373cfa3542 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:06.925752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a342f7-0d35-4aac-a6b0-1cb1521c6230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:06.926463 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a342f7-0d35-4aac-a6b0-1cb1521c6230 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:06.926910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a342f7-0d35-4aac-a6b0-1cb1521c6230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:06.927273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a342f7-0d35-4aac-a6b0-1cb1521c6230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:06.944112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc174c-153a-43f3-bb92-9884d4d657f4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:06.944331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a342f7-0d35-4aac-a6b0-1cb1521c6230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:06.946246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a342f7-0d35-4aac-a6b0-1cb1521c6230 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:06.948519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae7dac-b01a-4378-a90a-78dbc8a3eb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:06.949298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7dac-b01a-4378-a90a-78dbc8a3eb69 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:06.949620 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7dac-b01a-4378-a90a-78dbc8a3eb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:06.949911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7dac-b01a-4378-a90a-78dbc8a3eb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:06.958985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 957/1892] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:06.960806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae7dac-b01a-4378-a90a-78dbc8a3eb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:06.962343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae7dac-b01a-4378-a90a-78dbc8a3eb69 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:06.981716 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 936/1893] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:44:07.485451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a342f7-0d35-4aac-a6b0-1cb1521c6230 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:07.488362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b2a342f7-0d35-4aac-a6b0-1cb1521c6230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:07.517110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a342f7-0d35-4aac-a6b0-1cb1521c6230 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:07.524671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:07.525492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:07.525866 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:07.527728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] PATH_INFO: `/v3/projects/928bbc391bbe43cd98046d34e08159d5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:07.529626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=928bbc391bbe43cd98046d34e08159d5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:07.542213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:07.603196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae7dac-b01a-4378-a90a-78dbc8a3eb69 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:07.604892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d4ae7dac-b01a-4378-a90a-78dbc8a3eb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:07.632077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae7dac-b01a-4378-a90a-78dbc8a3eb69 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:07.642283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:07.642961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:07.643264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:07.643563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] PATH_INFO: `/v3/projects/70f64cf669ba4d49ba428460b1d6f844` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:07.646207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f64cf669ba4d49ba428460b1d6f844)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:07.652638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:07.666031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928bbc391bbe43cd98046d34e08159d5', 'request_id': 'req-0e2267e0-d6f8-424f-897d-ffde8b85edaf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.675818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928bbc391bbe43cd98046d34e08159d5', 'request_id': 'req-0e2267e0-d6f8-424f-897d-ffde8b85edaf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.677108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:07.687352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928bbc391bbe43cd98046d34e08159d5', 'request_id': 'req-0e2267e0-d6f8-424f-897d-ffde8b85edaf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.705732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] The token cache is being invalidate because project 928bbc391bbe43cd98046d34e08159d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:07.706039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.706879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.708919 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 958/1894] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:07 2022] DELETE /identity/v3/projects/928bbc391bbe43cd98046d34e08159d5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:07.713945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:07.717114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:07.731114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f64cf669ba4d49ba428460b1d6f844', 'request_id': 'req-10166a61-6a48-41c1-8065-6ea6db74cd34'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.737985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f64cf669ba4d49ba428460b1d6f844', 'request_id': 'req-10166a61-6a48-41c1-8065-6ea6db74cd34'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.744400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f64cf669ba4d49ba428460b1d6f844', 'request_id': 'req-10166a61-6a48-41c1-8065-6ea6db74cd34'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.758634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] The token cache is being invalidate because project 70f64cf669ba4d49ba428460b1d6f844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:07.758972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.759597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10166a61-6a48-41c1-8065-6ea6db74cd34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.761467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 937/1895] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:07 2022] DELETE /identity/v3/projects/70f64cf669ba4d49ba428460b1d6f844 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:44:07.767851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57f2cc-4d0d-4dcd-86da-c868c27d84b2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:07.768218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57f2cc-4d0d-4dcd-86da-c868c27d84b2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:07.768559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57f2cc-4d0d-4dcd-86da-c868c27d84b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:07.788797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7a57f2cc-4d0d-4dcd-86da-c868c27d84b2 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:07.790098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7a57f2cc-4d0d-4dcd-86da-c868c27d84b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:07.795679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2267e0-d6f8-424f-897d-ffde8b85edaf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:07.821909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:07.873868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 938/1896] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:07.884871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e5451-1ead-4307-8dad-87098b2417ff None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:07.885201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e5451-1ead-4307-8dad-87098b2417ff None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:07.885422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e5451-1ead-4307-8dad-87098b2417ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:07.893691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:07.894393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:07.894672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:07.894977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] PATH_INFO: `/v3/users/2500c6e9461d44959c9b02a12316112e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:07.896377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2500c6e9461d44959c9b02a12316112e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:07.898491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:07.922512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-cc3e5451-1ead-4307-8dad-87098b2417ff None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:07.932329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cc3e5451-1ead-4307-8dad-87098b2417ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:07.943804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 939/1897] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:44:07.946869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e5451-1ead-4307-8dad-87098b2417ff None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:07.956286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e5451-1ead-4307-8dad-87098b2417ff None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:07.960867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:07.961545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:07.961883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:07.962213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:07.962980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:44:07.963327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:07.964985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:07.968971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2500c6e9461d44959c9b02a12316112e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.969644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2500c6e9461d44959c9b02a12316112e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.976909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 940/1898] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:44:07.977146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2500c6e9461d44959c9b02a12316112e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.981726 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:07.984490 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:07.989510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2500c6e9461d44959c9b02a12316112e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:07.990216 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2500c6e9461d44959c9b02a12316112e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.000407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221083f-b595-4dd9-9a96-3245ff818d83 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:08.006128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05e07c-a5b2-4b45-87db-1765f51d2d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:08.006888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05e07c-a5b2-4b45-87db-1765f51d2d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:08.007241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05e07c-a5b2-4b45-87db-1765f51d2d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:08.007517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05e07c-a5b2-4b45-87db-1765f51d2d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:08.008330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05e07c-a5b2-4b45-87db-1765f51d2d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:08.010318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05e07c-a5b2-4b45-87db-1765f51d2d5a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:08.019245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 959/1899] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:07 2022] DELETE /identity/v3/users/2500c6e9461d44959c9b02a12316112e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:44:08.048537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 941/1900] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:07 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:44:08.049786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:08.063363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:08.133517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840887-8a75-4817-b14f-4c0a6d5655e6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:08.207386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca8485-7e45-41d0-8d51-9527fafd25e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:08.208240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8485-7e45-41d0-8d51-9527fafd25e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:08.208585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8485-7e45-41d0-8d51-9527fafd25e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:08.209152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8485-7e45-41d0-8d51-9527fafd25e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:08.210160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca8485-7e45-41d0-8d51-9527fafd25e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:08.213550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca8485-7e45-41d0-8d51-9527fafd25e4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:08.254748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 960/1901] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:08 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:08.255306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05e07c-a5b2-4b45-87db-1765f51d2d5a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:08.268822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05e07c-a5b2-4b45-87db-1765f51d2d5a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:08.274575 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec33b1-5615-4312-9233-e9892f0d01f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:08.275512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec33b1-5615-4312-9233-e9892f0d01f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:08.275801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec33b1-5615-4312-9233-e9892f0d01f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:08.276155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec33b1-5615-4312-9233-e9892f0d01f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:08.276887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec33b1-5615-4312-9233-e9892f0d01f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:08.278526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec33b1-5615-4312-9233-e9892f0d01f3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:08.290373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 942/1902] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:44:08.294168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca8485-7e45-41d0-8d51-9527fafd25e4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:08.305522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca8485-7e45-41d0-8d51-9527fafd25e4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:08.315273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7ee7-ac46-4069-85f4-1732c6aa5c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:08.317410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7ee7-ac46-4069-85f4-1732c6aa5c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:08.319789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7ee7-ac46-4069-85f4-1732c6aa5c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:08.320252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7ee7-ac46-4069-85f4-1732c6aa5c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:08.322914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea7ee7-ac46-4069-85f4-1732c6aa5c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:08.332525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea7ee7-ac46-4069-85f4-1732c6aa5c7a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:08.352183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec33b1-5615-4312-9233-e9892f0d01f3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:08.354245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-37ec33b1-5615-4312-9233-e9892f0d01f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:08.355219 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 961/1903] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:44:08.359427 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7ee7-ac46-4069-85f4-1732c6aa5c7a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:08.372859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec33b1-5615-4312-9233-e9892f0d01f3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:08.373480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7ee7-ac46-4069-85f4-1732c6aa5c7a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:08.379530 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a478d7-cd58-4314-86e8-12313ff3d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:08.379710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:08.380129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a478d7-cd58-4314-86e8-12313ff3d653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:08.380460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a478d7-cd58-4314-86e8-12313ff3d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:08.380766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a478d7-cd58-4314-86e8-12313ff3d653 admin admin] PATH_INFO: `/v3/projects/39d3311175e24eccb521601cd6d0eb32/users/16205b158edc4edba8f00c5e13573047/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:08.386665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:08.386825 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:08.387292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] PATH_INFO: `/v3/projects/38067247ef0742558cbcfdc14ee7384f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:08.389275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38067247ef0742558cbcfdc14ee7384f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:08.391478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:08.403926 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a478d7-cd58-4314-86e8-12313ff3d653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d3311175e24eccb521601cd6d0eb32, user_id=16205b158edc4edba8f00c5e13573047, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:08.407095 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a478d7-cd58-4314-86e8-12313ff3d653 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:08.429028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 962/1904] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:08 2022] PUT /identity/v3/projects/39d3311175e24eccb521601cd6d0eb32/users/16205b158edc4edba8f00c5e13573047/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:08.460718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38067247ef0742558cbcfdc14ee7384f', 'request_id': 'req-cc7f2d67-28ae-4639-bb5c-760fde952ba8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.469003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38067247ef0742558cbcfdc14ee7384f', 'request_id': 'req-cc7f2d67-28ae-4639-bb5c-760fde952ba8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.476331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38067247ef0742558cbcfdc14ee7384f', 'request_id': 'req-cc7f2d67-28ae-4639-bb5c-760fde952ba8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.503510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804fd4b-db93-4e03-b9d1-ed905289e378 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:08.503795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804fd4b-db93-4e03-b9d1-ed905289e378 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:08.504095 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804fd4b-db93-4e03-b9d1-ed905289e378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:08.506731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] The token cache is being invalidate because project 38067247ef0742558cbcfdc14ee7384f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:08.507365 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.508306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.510351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 943/1905] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:08 2022] DELETE /identity/v3/projects/38067247ef0742558cbcfdc14ee7384f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:44:08.515988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:08.517500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:08.544510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c804fd4b-db93-4e03-b9d1-ed905289e378 None None] MFA Rules not processed for user `16205b158edc4edba8f00c5e13573047`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:08.545942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c804fd4b-db93-4e03-b9d1-ed905289e378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:08.621787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2d67-28ae-4639-bb5c-760fde952ba8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:08.627046 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:08.628102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:08.628476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:08.628980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] PATH_INFO: `/v3/users/dce81d0db54a4fc6b49107593d9de226` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:08.630269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce81d0db54a4fc6b49107593d9de226)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:08.632232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:08.635021 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:08.655867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 963/1906] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:44:08.670195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804fd4b-db93-4e03-b9d1-ed905289e378 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:08.672035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c804fd4b-db93-4e03-b9d1-ed905289e378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:08.681484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:08.710397 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce81d0db54a4fc6b49107593d9de226'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.711028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce81d0db54a4fc6b49107593d9de226'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.719632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce81d0db54a4fc6b49107593d9de226'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.733642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce81d0db54a4fc6b49107593d9de226'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.734487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce81d0db54a4fc6b49107593d9de226'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:08.767474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 944/1907] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:08 2022] DELETE /identity/v3/users/dce81d0db54a4fc6b49107593d9de226 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:08.775703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804fd4b-db93-4e03-b9d1-ed905289e378 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:08.853334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc131f07-2bf9-408b-a468-006c037f2b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:08.854157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc131f07-2bf9-408b-a468-006c037f2b58 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:08.854434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc131f07-2bf9-408b-a468-006c037f2b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:08.854700 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc131f07-2bf9-408b-a468-006c037f2b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:08.857036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bc131f07-2bf9-408b-a468-006c037f2b58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:08.962572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc131f07-2bf9-408b-a468-006c037f2b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:08.964092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc131f07-2bf9-408b-a468-006c037f2b58 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:08.988604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 964/1908] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:08 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:09.182794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:09.184568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:09.297380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69089-e950-4eeb-9047-ee3ef3befcdb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:09.311780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:09.312450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:09.312724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:09.312994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] PATH_INFO: `/v3/projects/88b4b19de760457e90daf94696120fe8` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:09.314229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b4b19de760457e90daf94696120fe8)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:09.317131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:09.415686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b4b19de760457e90daf94696120fe8', 'request_id': 'req-2209df2e-6a29-4bc3-a369-c5f87b162a9c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:09.425271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b4b19de760457e90daf94696120fe8', 'request_id': 'req-2209df2e-6a29-4bc3-a369-c5f87b162a9c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:09.431329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b4b19de760457e90daf94696120fe8', 'request_id': 'req-2209df2e-6a29-4bc3-a369-c5f87b162a9c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:09.445264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] The token cache is being invalidate because project 88b4b19de760457e90daf94696120fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:09.445644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:09.446356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2209df2e-6a29-4bc3-a369-c5f87b162a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:09.448432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 945/1909] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:09 2022] DELETE /identity/v3/projects/88b4b19de760457e90daf94696120fe8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:09.454584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ff60d-1509-4a2f-8640-9ee1683a4f13 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:09.454983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ff60d-1509-4a2f-8640-9ee1683a4f13 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:09.455426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ff60d-1509-4a2f-8640-9ee1683a4f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:09.481443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0f9ff60d-1509-4a2f-8640-9ee1683a4f13 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:09.482908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0f9ff60d-1509-4a2f-8640-9ee1683a4f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:09.581214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 965/1910] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:09.595047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b44a05-bea2-45c7-ad07-57550fb8b2d7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:09.595047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b44a05-bea2-45c7-ad07-57550fb8b2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:09.595047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b44a05-bea2-45c7-ad07-57550fb8b2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:09.612206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e3b44a05-bea2-45c7-ad07-57550fb8b2d7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:09.613436 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e3b44a05-bea2-45c7-ad07-57550fb8b2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:09.622206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 946/1911] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:09.626949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ff60d-1509-4a2f-8640-9ee1683a4f13 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:09.644447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ff60d-1509-4a2f-8640-9ee1683a4f13 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:09.649704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc73878-d967-46dc-9f7d-e675f2e3be21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:09.650419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc73878-d967-46dc-9f7d-e675f2e3be21 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:09.650765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc73878-d967-46dc-9f7d-e675f2e3be21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:09.651150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc73878-d967-46dc-9f7d-e675f2e3be21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:09.652050 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc73878-d967-46dc-9f7d-e675f2e3be21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:44:09.652423 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc73878-d967-46dc-9f7d-e675f2e3be21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:09.654195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc73878-d967-46dc-9f7d-e675f2e3be21 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:09.667797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 966/1912] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:44:09.672902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b44a05-bea2-45c7-ad07-57550fb8b2d7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:09.680736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:09.686019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b44a05-bea2-45c7-ad07-57550fb8b2d7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:09.692579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452b2f4-6c3b-4211-92c8-e8356677218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:09.693512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452b2f4-6c3b-4211-92c8-e8356677218d admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:09.693788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452b2f4-6c3b-4211-92c8-e8356677218d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:09.694095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452b2f4-6c3b-4211-92c8-e8356677218d admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:09.694953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452b2f4-6c3b-4211-92c8-e8356677218d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:09.697365 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452b2f4-6c3b-4211-92c8-e8356677218d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:09.738285 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 947/1913] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:09 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:09.740107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc73878-d967-46dc-9f7d-e675f2e3be21 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:09.747236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:09.754083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc73878-d967-46dc-9f7d-e675f2e3be21 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:09.831756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1eaa0-fe33-4d81-9761-ae5c4ad9ea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:09.832380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1eaa0-fe33-4d81-9761-ae5c4ad9ea88 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:09.832678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1eaa0-fe33-4d81-9761-ae5c4ad9ea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:09.832945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1eaa0-fe33-4d81-9761-ae5c4ad9ea88 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:09.833578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1eaa0-fe33-4d81-9761-ae5c4ad9ea88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:09.835568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1eaa0-fe33-4d81-9761-ae5c4ad9ea88 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:09.864623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 967/1914] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:09 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:09.865988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452b2f4-6c3b-4211-92c8-e8356677218d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:09.876877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452b2f4-6c3b-4211-92c8-e8356677218d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:09.882233 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c823b-a788-4c5f-bd0a-b6b23bc747a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:09.883044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c823b-a788-4c5f-bd0a-b6b23bc747a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:09.883425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c823b-a788-4c5f-bd0a-b6b23bc747a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:09.883783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c823b-a788-4c5f-bd0a-b6b23bc747a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:09.884501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c823b-a788-4c5f-bd0a-b6b23bc747a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:09.886219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c823b-a788-4c5f-bd0a-b6b23bc747a1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:09.909566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 948/1915] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:09.910862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1eaa0-fe33-4d81-9761-ae5c4ad9ea88 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:09.924227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1eaa0-fe33-4d81-9761-ae5c4ad9ea88 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:09.932278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3a80d-79aa-4fd7-a3e6-86c386aa25b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:09.932913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3a80d-79aa-4fd7-a3e6-86c386aa25b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:09.933193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3a80d-79aa-4fd7-a3e6-86c386aa25b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:09.933461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3a80d-79aa-4fd7-a3e6-86c386aa25b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:09.934113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3a80d-79aa-4fd7-a3e6-86c386aa25b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:09.935907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3a80d-79aa-4fd7-a3e6-86c386aa25b7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:09.948422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 968/1916] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:09.952932 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c823b-a788-4c5f-bd0a-b6b23bc747a1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:09.965489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c823b-a788-4c5f-bd0a-b6b23bc747a1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:09.971155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c245-e9b9-4aff-93cc-43c2373f0198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:09.972088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c245-e9b9-4aff-93cc-43c2373f0198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:09.972235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c245-e9b9-4aff-93cc-43c2373f0198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:09.972552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c245-e9b9-4aff-93cc-43c2373f0198 admin admin] PATH_INFO: `/v3/projects/1ceb0fb506904bf28a1eb62eaab03cab/users/b5ea043bac834110864b38f6a263dbfc/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.007938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44c245-e9b9-4aff-93cc-43c2373f0198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ceb0fb506904bf28a1eb62eaab03cab, user_id=b5ea043bac834110864b38f6a263dbfc, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:10.011044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44c245-e9b9-4aff-93cc-43c2373f0198 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:10.031056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 949/1917] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:09 2022] PUT /identity/v3/projects/1ceb0fb506904bf28a1eb62eaab03cab/users/b5ea043bac834110864b38f6a263dbfc/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:44:10.041679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152ce50-6dc2-4124-bcf7-dbbec2169103 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:10.042161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152ce50-6dc2-4124-bcf7-dbbec2169103 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:10.042437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152ce50-6dc2-4124-bcf7-dbbec2169103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.070107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c152ce50-6dc2-4124-bcf7-dbbec2169103 None None] MFA Rules not processed for user `b5ea043bac834110864b38f6a263dbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:10.071374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c152ce50-6dc2-4124-bcf7-dbbec2169103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:10.142372 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 969/1918] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:44:10.147071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c245-e9b9-4aff-93cc-43c2373f0198 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:10.216339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c245-e9b9-4aff-93cc-43c2373f0198 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:10.221102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c398f-b193-499c-9a01-44c10dd495d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:10.221744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c398f-b193-499c-9a01-44c10dd495d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:10.222042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c398f-b193-499c-9a01-44c10dd495d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:10.222337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c398f-b193-499c-9a01-44c10dd495d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.223052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c398f-b193-499c-9a01-44c10dd495d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:10.225073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c398f-b193-499c-9a01-44c10dd495d2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:10.269191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 950/1919] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:10 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:10.273100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152ce50-6dc2-4124-bcf7-dbbec2169103 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:10.285678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152ce50-6dc2-4124-bcf7-dbbec2169103 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:10.347564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eaf99-e1ad-4d7d-b9e6-7cbdf8c6bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:10.348184 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eaf99-e1ad-4d7d-b9e6-7cbdf8c6bb6a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:10.348453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eaf99-e1ad-4d7d-b9e6-7cbdf8c6bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:10.348716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eaf99-e1ad-4d7d-b9e6-7cbdf8c6bb6a admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.349342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eaf99-e1ad-4d7d-b9e6-7cbdf8c6bb6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:10.351425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eaf99-e1ad-4d7d-b9e6-7cbdf8c6bb6a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:10.369381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:10.376145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 970/1920] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:10 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:10.380060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c398f-b193-499c-9a01-44c10dd495d2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:10.397068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c398f-b193-499c-9a01-44c10dd495d2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:10.402843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57102f5-a589-4c64-a964-fecc3bca1a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:10.403573 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57102f5-a589-4c64-a964-fecc3bca1a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:10.403847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57102f5-a589-4c64-a964-fecc3bca1a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:10.404115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57102f5-a589-4c64-a964-fecc3bca1a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.404835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57102f5-a589-4c64-a964-fecc3bca1a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:10.406797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57102f5-a589-4c64-a964-fecc3bca1a28 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:10.422317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 951/1921] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:10.423682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eaf99-e1ad-4d7d-b9e6-7cbdf8c6bb6a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:10.434146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eaf99-e1ad-4d7d-b9e6-7cbdf8c6bb6a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:10.439086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b9c92-25b1-4999-a768-9b3856e249fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:10.439858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b9c92-25b1-4999-a768-9b3856e249fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:10.440183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b9c92-25b1-4999-a768-9b3856e249fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:10.440502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b9c92-25b1-4999-a768-9b3856e249fa admin admin] PATH_INFO: `/v3/projects/2a306e04d2e44e0b81e14cbf14269208/users/8b93ecee1bb34d06b3f28f455a2c9e11/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.457805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b9c92-25b1-4999-a768-9b3856e249fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a306e04d2e44e0b81e14cbf14269208, user_id=8b93ecee1bb34d06b3f28f455a2c9e11, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:10.460644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b9c92-25b1-4999-a768-9b3856e249fa admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:10.478311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 971/1922] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:10 2022] PUT /identity/v3/projects/2a306e04d2e44e0b81e14cbf14269208/users/8b93ecee1bb34d06b3f28f455a2c9e11/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:10.482860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57102f5-a589-4c64-a964-fecc3bca1a28 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:10.494750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57102f5-a589-4c64-a964-fecc3bca1a28 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:10.568402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b967c-f6f2-45a1-921c-d5a709e1386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:10.569091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b967c-f6f2-45a1-921c-d5a709e1386e admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:10.569374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b967c-f6f2-45a1-921c-d5a709e1386e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:10.569690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b967c-f6f2-45a1-921c-d5a709e1386e admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.570401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b967c-f6f2-45a1-921c-d5a709e1386e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:10.572336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b967c-f6f2-45a1-921c-d5a709e1386e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:10.584729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 952/1923] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:44:10.589995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b9c92-25b1-4999-a768-9b3856e249fa admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:10.601880 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b9c92-25b1-4999-a768-9b3856e249fa admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:10.608343 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e43637-3a5f-485d-8e82-b2c6c33c81cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:10.609200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e43637-3a5f-485d-8e82-b2c6c33c81cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:10.609699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e43637-3a5f-485d-8e82-b2c6c33c81cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:10.610065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e43637-3a5f-485d-8e82-b2c6c33c81cd admin admin] PATH_INFO: `/v3/projects/2a306e04d2e44e0b81e14cbf14269208/users/8b93ecee1bb34d06b3f28f455a2c9e11/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.612435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e43637-3a5f-485d-8e82-b2c6c33c81cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a306e04d2e44e0b81e14cbf14269208, user_id=8b93ecee1bb34d06b3f28f455a2c9e11, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:10.615216 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e43637-3a5f-485d-8e82-b2c6c33c81cd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:10.626692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 972/1924] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:10 2022] PUT /identity/v3/projects/2a306e04d2e44e0b81e14cbf14269208/users/8b93ecee1bb34d06b3f28f455a2c9e11/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:10.637251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b9a0d-d5d9-461d-b99d-5f7c0a327c9c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:10.637775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b9a0d-d5d9-461d-b99d-5f7c0a327c9c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:10.638253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b9a0d-d5d9-461d-b99d-5f7c0a327c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.673111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c85b9a0d-d5d9-461d-b99d-5f7c0a327c9c None None] MFA Rules not processed for user `8b93ecee1bb34d06b3f28f455a2c9e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:10.674414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c85b9a0d-d5d9-461d-b99d-5f7c0a327c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:10.684178 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:10.748799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 953/1925] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:10.760243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e43637-3a5f-485d-8e82-b2c6c33c81cd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:10.762074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a7e43637-3a5f-485d-8e82-b2c6c33c81cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:10.838203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e43637-3a5f-485d-8e82-b2c6c33c81cd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:10.842101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f27b50-7f18-460d-a883-94db79f8dd3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:10.842868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f27b50-7f18-460d-a883-94db79f8dd3b service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:10.843234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f27b50-7f18-460d-a883-94db79f8dd3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:10.843566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f27b50-7f18-460d-a883-94db79f8dd3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:10.852987 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f27b50-7f18-460d-a883-94db79f8dd3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:10.854530 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f27b50-7f18-460d-a883-94db79f8dd3b service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:10.868307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 973/1926] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:11.326872 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b9a0d-d5d9-461d-b99d-5f7c0a327c9c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:11.415995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b9a0d-d5d9-461d-b99d-5f7c0a327c9c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:11.422274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:11.423033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:11.423331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:11.423598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] PATH_INFO: `/v3/users/b5ea043bac834110864b38f6a263dbfc` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:11.424849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ea043bac834110864b38f6a263dbfc)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:11.427012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:11.497237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ea043bac834110864b38f6a263dbfc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:11.497237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ea043bac834110864b38f6a263dbfc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:11.503891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ea043bac834110864b38f6a263dbfc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:11.540326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ea043bac834110864b38f6a263dbfc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:11.541093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ea043bac834110864b38f6a263dbfc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:11.560189 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 954/1927] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:11 2022] DELETE /identity/v3/users/b5ea043bac834110864b38f6a263dbfc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:11.567355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a01887-833a-426a-8fcd-04dd5dc2f892 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:11.568002 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a01887-833a-426a-8fcd-04dd5dc2f892 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:11.568444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a01887-833a-426a-8fcd-04dd5dc2f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:11.592946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-69a01887-833a-426a-8fcd-04dd5dc2f892 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:11.594965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-69a01887-833a-426a-8fcd-04dd5dc2f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:11.696029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 974/1928] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:44:11.711427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:11.711427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:11.742514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:11.778666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eafd6d-cafc-45c5-b7d3-eb0c1198bab0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:11.783175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc26cef-1d16-41d3-b599-26246803ab7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:11.783920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc26cef-1d16-41d3-b599-26246803ab7b service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:11.784280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc26cef-1d16-41d3-b599-26246803ab7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:11.784550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc26cef-1d16-41d3-b599-26246803ab7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:11.795107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc26cef-1d16-41d3-b599-26246803ab7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:11.796895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc26cef-1d16-41d3-b599-26246803ab7b service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:11.806454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 955/1929] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:12.127285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a01887-833a-426a-8fcd-04dd5dc2f892 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:12.130583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-69a01887-833a-426a-8fcd-04dd5dc2f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:12.149481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a01887-833a-426a-8fcd-04dd5dc2f892 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:12.156239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:12.157863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:12.158284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:12.158557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] PATH_INFO: `/v3/projects/1ceb0fb506904bf28a1eb62eaab03cab` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:12.160398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ceb0fb506904bf28a1eb62eaab03cab)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:12.162671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:12.216841 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ceb0fb506904bf28a1eb62eaab03cab', 'request_id': 'req-c8232737-9845-41ab-a84b-e51a6944c39e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.231465 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ceb0fb506904bf28a1eb62eaab03cab', 'request_id': 'req-c8232737-9845-41ab-a84b-e51a6944c39e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.234667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:12.242831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ceb0fb506904bf28a1eb62eaab03cab', 'request_id': 'req-c8232737-9845-41ab-a84b-e51a6944c39e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.263292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] The token cache is being invalidate because project 1ceb0fb506904bf28a1eb62eaab03cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:12.263996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.265088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.266781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 975/1930] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:12 2022] DELETE /identity/v3/projects/1ceb0fb506904bf28a1eb62eaab03cab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:12.270878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc26cef-1d16-41d3-b599-26246803ab7b service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:12.289557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc26cef-1d16-41d3-b599-26246803ab7b service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:12.422900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:12.426990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:12.426990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:12.426990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] PATH_INFO: `/v3/users/8b93ecee1bb34d06b3f28f455a2c9e11` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:12.427911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b93ecee1bb34d06b3f28f455a2c9e11)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:12.429968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:12.482676 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b93ecee1bb34d06b3f28f455a2c9e11'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.487129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b93ecee1bb34d06b3f28f455a2c9e11'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.495036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b93ecee1bb34d06b3f28f455a2c9e11'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.508754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b93ecee1bb34d06b3f28f455a2c9e11'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.510078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4734d140-a7ed-40d8-a5f3-d0bb607b3419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b93ecee1bb34d06b3f28f455a2c9e11'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:12.536738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 956/1931] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:12 2022] DELETE /identity/v3/users/8b93ecee1bb34d06b3f28f455a2c9e11 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:12.876567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:12.878207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:12.892594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8232737-9845-41ab-a84b-e51a6944c39e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:12.951242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:12.951925 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:12.952224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:12.952492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] PATH_INFO: `/v3/projects/2a306e04d2e44e0b81e14cbf14269208` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:12.953687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a306e04d2e44e0b81e14cbf14269208)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:12.955759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.007978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a306e04d2e44e0b81e14cbf14269208', 'request_id': 'req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:13.013479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a306e04d2e44e0b81e14cbf14269208', 'request_id': 'req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:13.020130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a306e04d2e44e0b81e14cbf14269208', 'request_id': 'req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:13.039562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] The token cache is being invalidate because project 2a306e04d2e44e0b81e14cbf14269208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:13.039852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:13.040544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5e02651b-6b38-41e2-80dd-e88e19a3ba3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:13.042144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 976/1932] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:12 2022] DELETE /identity/v3/projects/2a306e04d2e44e0b81e14cbf14269208 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:13.047592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa043ec-ab79-4c32-a902-88ef178d73fb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.048142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa043ec-ab79-4c32-a902-88ef178d73fb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.048142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa043ec-ab79-4c32-a902-88ef178d73fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.069112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6fa043ec-ab79-4c32-a902-88ef178d73fb None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:13.070447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6fa043ec-ab79-4c32-a902-88ef178d73fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:13.116605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:13.145699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 957/1933] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:13.155043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8a837-7ad5-44a3-b3d2-a68e203e22f9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.155689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8a837-7ad5-44a3-b3d2-a68e203e22f9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.155955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8a837-7ad5-44a3-b3d2-a68e203e22f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.178738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1bb8a837-7ad5-44a3-b3d2-a68e203e22f9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:13.180036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1bb8a837-7ad5-44a3-b3d2-a68e203e22f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:13.194734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa043ec-ab79-4c32-a902-88ef178d73fb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.203290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 977/1934] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:13.206012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa043ec-ab79-4c32-a902-88ef178d73fb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.211063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49389-1805-4676-be5d-4b22f15145d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.211745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49389-1805-4676-be5d-4b22f15145d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.212077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49389-1805-4676-be5d-4b22f15145d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.212454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49389-1805-4676-be5d-4b22f15145d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.213203 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b49389-1805-4676-be5d-4b22f15145d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:44:13.213594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b49389-1805-4676-be5d-4b22f15145d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:13.215316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b49389-1805-4676-be5d-4b22f15145d8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.231962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 958/1935] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:44:13.233154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8a837-7ad5-44a3-b3d2-a68e203e22f9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.244443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8a837-7ad5-44a3-b3d2-a68e203e22f9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.249942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4df366-d42b-481b-a2a1-26205b3937e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.250568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4df366-d42b-481b-a2a1-26205b3937e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.251380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4df366-d42b-481b-a2a1-26205b3937e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.252080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4df366-d42b-481b-a2a1-26205b3937e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.252727 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4df366-d42b-481b-a2a1-26205b3937e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:13.254656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4df366-d42b-481b-a2a1-26205b3937e1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.286883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 978/1936] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:13 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:13.292404 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49389-1805-4676-be5d-4b22f15145d8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.303998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49389-1805-4676-be5d-4b22f15145d8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.404123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d83c95-50a8-404f-98d7-cff353d9249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.404778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d83c95-50a8-404f-98d7-cff353d9249d admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.405061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d83c95-50a8-404f-98d7-cff353d9249d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.405520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d83c95-50a8-404f-98d7-cff353d9249d admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.406988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d83c95-50a8-404f-98d7-cff353d9249d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:13.409576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d83c95-50a8-404f-98d7-cff353d9249d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.439993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 959/1937] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:13 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:44:13.441186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4df366-d42b-481b-a2a1-26205b3937e1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.452305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4df366-d42b-481b-a2a1-26205b3937e1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.457437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0e6fd-68d0-4bbd-aff0-21099afdd018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.458062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0e6fd-68d0-4bbd-aff0-21099afdd018 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.458336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0e6fd-68d0-4bbd-aff0-21099afdd018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.458599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0e6fd-68d0-4bbd-aff0-21099afdd018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.459398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0e6fd-68d0-4bbd-aff0-21099afdd018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:13.461047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0e6fd-68d0-4bbd-aff0-21099afdd018 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.473123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 979/1938] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:44:13.477767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d83c95-50a8-404f-98d7-cff353d9249d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.489262 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d83c95-50a8-404f-98d7-cff353d9249d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.494761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bbcd9-7877-4b61-aa55-b3def5c79c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.495568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bbcd9-7877-4b61-aa55-b3def5c79c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.495944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bbcd9-7877-4b61-aa55-b3def5c79c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.496430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bbcd9-7877-4b61-aa55-b3def5c79c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.497114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bbcd9-7877-4b61-aa55-b3def5c79c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:13.499352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bbcd9-7877-4b61-aa55-b3def5c79c6d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.511673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 960/1939] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:13.518603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0e6fd-68d0-4bbd-aff0-21099afdd018 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.534297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0e6fd-68d0-4bbd-aff0-21099afdd018 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.543223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687ff7b-9df4-4127-8e9d-0738d4f571c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.546200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687ff7b-9df4-4127-8e9d-0738d4f571c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.546540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687ff7b-9df4-4127-8e9d-0738d4f571c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.546880 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687ff7b-9df4-4127-8e9d-0738d4f571c0 admin admin] PATH_INFO: `/v3/projects/650400a1ceb543bca08bc95ec84c4332/users/267757c739784b2196f4c1c66ea99dd6/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.567028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687ff7b-9df4-4127-8e9d-0738d4f571c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650400a1ceb543bca08bc95ec84c4332, user_id=267757c739784b2196f4c1c66ea99dd6, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:13.569676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687ff7b-9df4-4127-8e9d-0738d4f571c0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.585552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 980/1940] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:13 2022] PUT /identity/v3/projects/650400a1ceb543bca08bc95ec84c4332/users/267757c739784b2196f4c1c66ea99dd6/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:13.600469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78e6a-ef6c-441d-898d-73e7643a195a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.601162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78e6a-ef6c-441d-898d-73e7643a195a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.601588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78e6a-ef6c-441d-898d-73e7643a195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.634610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-92a78e6a-ef6c-441d-898d-73e7643a195a None None] MFA Rules not processed for user `267757c739784b2196f4c1c66ea99dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:13.635920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-92a78e6a-ef6c-441d-898d-73e7643a195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:13.701931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 961/1941] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:13.706340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687ff7b-9df4-4127-8e9d-0738d4f571c0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.725475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:13.771805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687ff7b-9df4-4127-8e9d-0738d4f571c0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.776709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599ba0e-33fd-4aac-99fb-4c37c3c144bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.777488 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599ba0e-33fd-4aac-99fb-4c37c3c144bd admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.777767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599ba0e-33fd-4aac-99fb-4c37c3c144bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.778032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599ba0e-33fd-4aac-99fb-4c37c3c144bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.778662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599ba0e-33fd-4aac-99fb-4c37c3c144bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:13.780658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599ba0e-33fd-4aac-99fb-4c37c3c144bd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.813287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 981/1942] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:13 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:13.817524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78e6a-ef6c-441d-898d-73e7643a195a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.828853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78e6a-ef6c-441d-898d-73e7643a195a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.872993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:13.895206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d03e2-e379-4dc1-9ab0-94f86cb6b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.896138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d03e2-e379-4dc1-9ab0-94f86cb6b363 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.896138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d03e2-e379-4dc1-9ab0-94f86cb6b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.896328 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d03e2-e379-4dc1-9ab0-94f86cb6b363 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.896860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d03e2-e379-4dc1-9ab0-94f86cb6b363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:13.898784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d03e2-e379-4dc1-9ab0-94f86cb6b363 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.932124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 962/1943] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:13 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:13.936311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599ba0e-33fd-4aac-99fb-4c37c3c144bd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.948975 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599ba0e-33fd-4aac-99fb-4c37c3c144bd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.959491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0545454-9531-4297-8e7d-55c176911a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.959491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0545454-9531-4297-8e7d-55c176911a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.959491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0545454-9531-4297-8e7d-55c176911a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.959491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0545454-9531-4297-8e7d-55c176911a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:13.959820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0545454-9531-4297-8e7d-55c176911a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:13.959820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0545454-9531-4297-8e7d-55c176911a15 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:13.970113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 982/1944] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:13.974354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d03e2-e379-4dc1-9ab0-94f86cb6b363 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:13.984408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d03e2-e379-4dc1-9ab0-94f86cb6b363 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:13.989054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087d9d9-48e8-48e9-8c37-6d578a9e5f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:13.989712 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087d9d9-48e8-48e9-8c37-6d578a9e5f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:13.989987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087d9d9-48e8-48e9-8c37-6d578a9e5f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:13.990258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087d9d9-48e8-48e9-8c37-6d578a9e5f22 admin admin] PATH_INFO: `/v3/projects/8b31078039c345a2b7425390047aa2b8/users/ab384dc09f2b47469a040f10b7a63447/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.006153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087d9d9-48e8-48e9-8c37-6d578a9e5f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b31078039c345a2b7425390047aa2b8, user_id=ab384dc09f2b47469a040f10b7a63447, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:14.008885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087d9d9-48e8-48e9-8c37-6d578a9e5f22 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:14.025570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 963/1945] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:13 2022] PUT /identity/v3/projects/8b31078039c345a2b7425390047aa2b8/users/ab384dc09f2b47469a040f10b7a63447/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:14.030532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0545454-9531-4297-8e7d-55c176911a15 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:14.040782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0545454-9531-4297-8e7d-55c176911a15 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:14.097047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e13d2-788a-4b24-8d66-6fd48842ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:14.097667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e13d2-788a-4b24-8d66-6fd48842ae5c admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.097963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e13d2-788a-4b24-8d66-6fd48842ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.098227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e13d2-788a-4b24-8d66-6fd48842ae5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.098894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e13d2-788a-4b24-8d66-6fd48842ae5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:14.100727 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e13d2-788a-4b24-8d66-6fd48842ae5c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:14.111955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 983/1946] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:14.116345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087d9d9-48e8-48e9-8c37-6d578a9e5f22 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:14.127694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087d9d9-48e8-48e9-8c37-6d578a9e5f22 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:14.133301 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d721ca-4f0f-4683-86f9-4b72c9bc7c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:14.133978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d721ca-4f0f-4683-86f9-4b72c9bc7c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.134245 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d721ca-4f0f-4683-86f9-4b72c9bc7c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.134506 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d721ca-4f0f-4683-86f9-4b72c9bc7c96 admin admin] PATH_INFO: `/v3/projects/8b31078039c345a2b7425390047aa2b8/users/ab384dc09f2b47469a040f10b7a63447/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.136660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d721ca-4f0f-4683-86f9-4b72c9bc7c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b31078039c345a2b7425390047aa2b8, user_id=ab384dc09f2b47469a040f10b7a63447, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:14.139743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d721ca-4f0f-4683-86f9-4b72c9bc7c96 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:14.151508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 964/1947] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:14 2022] PUT /identity/v3/projects/8b31078039c345a2b7425390047aa2b8/users/ab384dc09f2b47469a040f10b7a63447/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:14.162083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45143b-6bff-473c-b356-d67931040300 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.162599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45143b-6bff-473c-b356-d67931040300 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.162690 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45143b-6bff-473c-b356-d67931040300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.194524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fb45143b-6bff-473c-b356-d67931040300 None None] MFA Rules not processed for user `ab384dc09f2b47469a040f10b7a63447`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:14.195780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fb45143b-6bff-473c-b356-d67931040300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:14.268328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 984/1948] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:14.282734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d721ca-4f0f-4683-86f9-4b72c9bc7c96 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:14.284690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d3d721ca-4f0f-4683-86f9-4b72c9bc7c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:14.343735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d721ca-4f0f-4683-86f9-4b72c9bc7c96 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:14.347738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381817-60c8-47c1-9bbb-018928bd3419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:14.348374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381817-60c8-47c1-9bbb-018928bd3419 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.348651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381817-60c8-47c1-9bbb-018928bd3419 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.348957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381817-60c8-47c1-9bbb-018928bd3419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.358400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381817-60c8-47c1-9bbb-018928bd3419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:14.359847 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381817-60c8-47c1-9bbb-018928bd3419 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:14.369229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 965/1949] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:14.395793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45143b-6bff-473c-b356-d67931040300 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:14.397432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fb45143b-6bff-473c-b356-d67931040300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:14.411886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:14.462574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381817-60c8-47c1-9bbb-018928bd3419 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:14.468838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45143b-6bff-473c-b356-d67931040300 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:14.471598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381817-60c8-47c1-9bbb-018928bd3419 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:14.473367 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:14.474003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.474275 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.474542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] PATH_INFO: `/v3/users/16205b158edc4edba8f00c5e13573047` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.475686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=16205b158edc4edba8f00c5e13573047)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:14.475907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3d5d3-d08a-47d5-9637-fb0a2bcf9eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:14.476507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3d5d3-d08a-47d5-9637-fb0a2bcf9eef service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.476782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3d5d3-d08a-47d5-9637-fb0a2bcf9eef service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.477050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3d5d3-d08a-47d5-9637-fb0a2bcf9eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.477603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:14.528548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16205b158edc4edba8f00c5e13573047'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.529226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16205b158edc4edba8f00c5e13573047'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.536312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16205b158edc4edba8f00c5e13573047'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.537843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3d5d3-d08a-47d5-9637-fb0a2bcf9eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:14.539517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3d5d3-d08a-47d5-9637-fb0a2bcf9eef service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:14.549447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 966/1950] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:14.549683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16205b158edc4edba8f00c5e13573047'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.550279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16205b158edc4edba8f00c5e13573047'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.565305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 985/1951] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:14 2022] DELETE /identity/v3/users/16205b158edc4edba8f00c5e13573047 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:14.569984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c047d-718c-4da5-84e0-ee2c2079e3f2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.570268 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c047d-718c-4da5-84e0-ee2c2079e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.570543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c047d-718c-4da5-84e0-ee2c2079e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.590386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-651c047d-718c-4da5-84e0-ee2c2079e3f2 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:14.591622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-651c047d-718c-4da5-84e0-ee2c2079e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:14.622706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:14.662285 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 967/1952] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:14.673034 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:14.674486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:14.740284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba9394-fd9e-447e-942c-64bdab0ef5ff admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:14.743895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8a3fb-378f-44ba-bb43-191b07f402b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:14.744517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8a3fb-378f-44ba-bb43-191b07f402b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.744842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8a3fb-378f-44ba-bb43-191b07f402b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.745055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8a3fb-378f-44ba-bb43-191b07f402b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.755308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8a3fb-378f-44ba-bb43-191b07f402b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:14.756771 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8a3fb-378f-44ba-bb43-191b07f402b8 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:14.767860 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 986/1953] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:14.832879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c047d-718c-4da5-84e0-ee2c2079e3f2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:14.834335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-651c047d-718c-4da5-84e0-ee2c2079e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:14.846971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c047d-718c-4da5-84e0-ee2c2079e3f2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:14.853875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:14.854898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.854898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.855216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] PATH_INFO: `/v3/users/267757c739784b2196f4c1c66ea99dd6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.856264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=267757c739784b2196f4c1c66ea99dd6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:14.858285 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:14.912497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267757c739784b2196f4c1c66ea99dd6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.913155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267757c739784b2196f4c1c66ea99dd6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.921789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267757c739784b2196f4c1c66ea99dd6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.935216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267757c739784b2196f4c1c66ea99dd6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.935935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267757c739784b2196f4c1c66ea99dd6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:14.955313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 968/1954] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:14 2022] DELETE /identity/v3/users/267757c739784b2196f4c1c66ea99dd6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:14.960406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aeb1de-9e8c-4553-87b8-67fe8c61630f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:14.960759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aeb1de-9e8c-4553-87b8-67fe8c61630f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:14.961349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aeb1de-9e8c-4553-87b8-67fe8c61630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:14.982706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-07aeb1de-9e8c-4553-87b8-67fe8c61630f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:14.984029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-07aeb1de-9e8c-4553-87b8-67fe8c61630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:15.018197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:15.059688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 987/1955] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:15.075513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:15.077204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:15.139963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aeb1de-9e8c-4553-87b8-67fe8c61630f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:15.142165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-07aeb1de-9e8c-4553-87b8-67fe8c61630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:15.151709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6ea6d-69b7-42e1-9a28-0985c770db5f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:15.155031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aeb1de-9e8c-4553-87b8-67fe8c61630f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:15.155958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9341-7255-490e-86d1-d8766613a0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:15.156586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9341-7255-490e-86d1-d8766613a0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:15.156832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9341-7255-490e-86d1-d8766613a0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:15.157154 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9341-7255-490e-86d1-d8766613a0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:15.161033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:15.161768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:15.162144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:15.162732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] PATH_INFO: `/v3/projects/39d3311175e24eccb521601cd6d0eb32` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:15.163746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d3311175e24eccb521601cd6d0eb32)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:15.165837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:15.167320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e9341-7255-490e-86d1-d8766613a0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:15.168770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e9341-7255-490e-86d1-d8766613a0b9 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:15.179936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 969/1956] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:44:15.220197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d3311175e24eccb521601cd6d0eb32', 'request_id': 'req-18ab18f6-106e-4a12-9399-3e3cd7294878'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.226111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d3311175e24eccb521601cd6d0eb32', 'request_id': 'req-18ab18f6-106e-4a12-9399-3e3cd7294878'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.232634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d3311175e24eccb521601cd6d0eb32', 'request_id': 'req-18ab18f6-106e-4a12-9399-3e3cd7294878'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.246396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] The token cache is being invalidate because project 39d3311175e24eccb521601cd6d0eb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:15.246667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.247330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.248865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 988/1957] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:15 2022] DELETE /identity/v3/projects/39d3311175e24eccb521601cd6d0eb32 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:44:15.486490 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9341-7255-490e-86d1-d8766613a0b9 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:15.488044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-179e9341-7255-490e-86d1-d8766613a0b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:15.502259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9341-7255-490e-86d1-d8766613a0b9 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:15.550164 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:15.563742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:15.564374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:15.564653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:15.564924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] PATH_INFO: `/v3/projects/650400a1ceb543bca08bc95ec84c4332` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:15.566068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=650400a1ceb543bca08bc95ec84c4332)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:15.568029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:15.618316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650400a1ceb543bca08bc95ec84c4332', 'request_id': 'req-ecfc4760-6706-4836-843d-90b2a30bcc3c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.625192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650400a1ceb543bca08bc95ec84c4332', 'request_id': 'req-ecfc4760-6706-4836-843d-90b2a30bcc3c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.631048 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650400a1ceb543bca08bc95ec84c4332', 'request_id': 'req-ecfc4760-6706-4836-843d-90b2a30bcc3c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.646401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] The token cache is being invalidate because project 650400a1ceb543bca08bc95ec84c4332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:15.646678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.647368 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.648976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 970/1958] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:15 2022] DELETE /identity/v3/projects/650400a1ceb543bca08bc95ec84c4332 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:15.654572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:15.656242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:15.669317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab18f6-106e-4a12-9399-3e3cd7294878 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:15.729657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:15.730196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:15.730475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:15.730743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] PATH_INFO: `/v3/users/ab384dc09f2b47469a040f10b7a63447` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:15.732038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab384dc09f2b47469a040f10b7a63447)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:15.734192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:15.782796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab384dc09f2b47469a040f10b7a63447'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.783467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab384dc09f2b47469a040f10b7a63447'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.790505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab384dc09f2b47469a040f10b7a63447'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.792415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:15.804032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab384dc09f2b47469a040f10b7a63447'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.804684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-49ec44b8-9519-41b4-ab13-57ddddd65090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab384dc09f2b47469a040f10b7a63447'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:15.822181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 989/1959] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:15 2022] DELETE /identity/v3/users/ab384dc09f2b47469a040f10b7a63447 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:44:16.113476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:16.115567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:16.140678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4760-6706-4836-843d-90b2a30bcc3c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:16.216148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:16.218045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.218518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.219000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] PATH_INFO: `/v3/projects/8b31078039c345a2b7425390047aa2b8` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.220349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b31078039c345a2b7425390047aa2b8)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:16.222421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:16.271022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b31078039c345a2b7425390047aa2b8', 'request_id': 'req-b90902e5-e2ab-4899-8af6-cb0d9b3def88'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:16.277538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b31078039c345a2b7425390047aa2b8', 'request_id': 'req-b90902e5-e2ab-4899-8af6-cb0d9b3def88'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:16.283476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b31078039c345a2b7425390047aa2b8', 'request_id': 'req-b90902e5-e2ab-4899-8af6-cb0d9b3def88'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:16.297801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] The token cache is being invalidate because project 8b31078039c345a2b7425390047aa2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:16.298193 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:16.298991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b90902e5-e2ab-4899-8af6-cb0d9b3def88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:16.300666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 971/1960] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:16 2022] DELETE /identity/v3/projects/8b31078039c345a2b7425390047aa2b8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:16.307143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5bfb9-21fb-4e5f-95c9-1921b6d37a1d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.307625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5bfb9-21fb-4e5f-95c9-1921b6d37a1d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.307711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5bfb9-21fb-4e5f-95c9-1921b6d37a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.327955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e0c5bfb9-21fb-4e5f-95c9-1921b6d37a1d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:16.329165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e0c5bfb9-21fb-4e5f-95c9-1921b6d37a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:16.390558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 990/1961] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:16.399632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ed347-a7ed-42ed-9c4c-75192ea41d4d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.399909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ed347-a7ed-42ed-9c4c-75192ea41d4d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.400176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ed347-a7ed-42ed-9c4c-75192ea41d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.420777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-406ed347-a7ed-42ed-9c4c-75192ea41d4d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:16.422209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-406ed347-a7ed-42ed-9c4c-75192ea41d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:16.430385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 972/1962] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:16.434869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5bfb9-21fb-4e5f-95c9-1921b6d37a1d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:16.446018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5bfb9-21fb-4e5f-95c9-1921b6d37a1d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:16.452455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14876d33-44d6-41ba-9720-f3c96de8780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:16.453063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14876d33-44d6-41ba-9720-f3c96de8780b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.453329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14876d33-44d6-41ba-9720-f3c96de8780b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.453624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14876d33-44d6-41ba-9720-f3c96de8780b admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.454262 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14876d33-44d6-41ba-9720-f3c96de8780b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:44:16.454559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14876d33-44d6-41ba-9720-f3c96de8780b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:16.456198 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14876d33-44d6-41ba-9720-f3c96de8780b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:16.469039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 991/1963] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:44:16.473950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ed347-a7ed-42ed-9c4c-75192ea41d4d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:16.480643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:16.489312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ed347-a7ed-42ed-9c4c-75192ea41d4d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:16.497197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124218f6-8282-4361-a400-db718e3c575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:16.497836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124218f6-8282-4361-a400-db718e3c575c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.498110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124218f6-8282-4361-a400-db718e3c575c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.498405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124218f6-8282-4361-a400-db718e3c575c admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.499142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124218f6-8282-4361-a400-db718e3c575c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:16.501092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124218f6-8282-4361-a400-db718e3c575c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:16.532024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 973/1964] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:16 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:16.537917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14876d33-44d6-41ba-9720-f3c96de8780b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:16.549130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14876d33-44d6-41ba-9720-f3c96de8780b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:16.611326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9635d-41ec-4a82-af1a-52396b7dd8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:16.611925 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9635d-41ec-4a82-af1a-52396b7dd8da admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.612201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9635d-41ec-4a82-af1a-52396b7dd8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.612469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9635d-41ec-4a82-af1a-52396b7dd8da admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.613089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9635d-41ec-4a82-af1a-52396b7dd8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:16.615056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9635d-41ec-4a82-af1a-52396b7dd8da admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:16.641473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 992/1965] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:16 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:16.642795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124218f6-8282-4361-a400-db718e3c575c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:16.653134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124218f6-8282-4361-a400-db718e3c575c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:16.658795 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44174e7-91df-4910-a005-dec4dc7d0164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:16.659424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44174e7-91df-4910-a005-dec4dc7d0164 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.659696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44174e7-91df-4910-a005-dec4dc7d0164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.659958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44174e7-91df-4910-a005-dec4dc7d0164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.660668 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44174e7-91df-4910-a005-dec4dc7d0164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:16.662261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44174e7-91df-4910-a005-dec4dc7d0164 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:16.672703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 974/1966] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:16.676802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9635d-41ec-4a82-af1a-52396b7dd8da admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:16.686813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9635d-41ec-4a82-af1a-52396b7dd8da admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:16.691572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bd27f-e659-49ec-a4a2-c5d306319621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:16.692181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bd27f-e659-49ec-a4a2-c5d306319621 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.692441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bd27f-e659-49ec-a4a2-c5d306319621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.692769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bd27f-e659-49ec-a4a2-c5d306319621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.693413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bd27f-e659-49ec-a4a2-c5d306319621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:16.695048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bd27f-e659-49ec-a4a2-c5d306319621 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:16.707114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 993/1967] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:16.711526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44174e7-91df-4910-a005-dec4dc7d0164 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:16.722000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44174e7-91df-4910-a005-dec4dc7d0164 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:16.726875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fc8c8-2297-4b56-8663-7838b906a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:16.727554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fc8c8-2297-4b56-8663-7838b906a24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.727830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fc8c8-2297-4b56-8663-7838b906a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.728101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fc8c8-2297-4b56-8663-7838b906a24a admin admin] PATH_INFO: `/v3/projects/9a4a162b9b0348af85a6a2258d3acc50/users/68ae0186d21247bea602cf37cebeac63/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.743184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fc8c8-2297-4b56-8663-7838b906a24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4a162b9b0348af85a6a2258d3acc50, user_id=68ae0186d21247bea602cf37cebeac63, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:16.745763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fc8c8-2297-4b56-8663-7838b906a24a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:16.760664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 975/1968] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:16 2022] PUT /identity/v3/projects/9a4a162b9b0348af85a6a2258d3acc50/users/68ae0186d21247bea602cf37cebeac63/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:16.767318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b94b9b-d4b8-4d8f-b3a7-821bf48deaae None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.767688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b94b9b-d4b8-4d8f-b3a7-821bf48deaae None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.768096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b94b9b-d4b8-4d8f-b3a7-821bf48deaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.797581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-50b94b9b-d4b8-4d8f-b3a7-821bf48deaae None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:16.798792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-50b94b9b-d4b8-4d8f-b3a7-821bf48deaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:16.839972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:16.867942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 994/1969] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:16.878572 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fc8c8-2297-4b56-8663-7838b906a24a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:16.881589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7c8fc8c8-2297-4b56-8663-7838b906a24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:16.950626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fc8c8-2297-4b56-8663-7838b906a24a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:16.955413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af2425-1a2c-4eed-b65b-8a54efb52248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:16.956020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af2425-1a2c-4eed-b65b-8a54efb52248 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:16.956289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af2425-1a2c-4eed-b65b-8a54efb52248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:16.956559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af2425-1a2c-4eed-b65b-8a54efb52248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:16.966344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af2425-1a2c-4eed-b65b-8a54efb52248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:16.968007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af2425-1a2c-4eed-b65b-8a54efb52248 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:16.980213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 976/1970] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:17.946816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b1d2f-a151-4413-8928-f2f7531884f2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:17.947727 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b1d2f-a151-4413-8928-f2f7531884f2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:17.949704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b1d2f-a151-4413-8928-f2f7531884f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:18.019445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c43b1d2f-a151-4413-8928-f2f7531884f2 None None] MFA Rules not processed for user `68ae0186d21247bea602cf37cebeac63`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:18.022945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c43b1d2f-a151-4413-8928-f2f7531884f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:18.136236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 995/1971] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:18.141814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af2425-1a2c-4eed-b65b-8a54efb52248 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:18.152318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af2425-1a2c-4eed-b65b-8a54efb52248 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:18.157396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5c911-2089-4776-b4c6-797c6214c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:18.158005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5c911-2089-4776-b4c6-797c6214c1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:18.158275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5c911-2089-4776-b4c6-797c6214c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:18.158541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5c911-2089-4776-b4c6-797c6214c1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:18.159249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5c911-2089-4776-b4c6-797c6214c1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:18.161140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5c911-2089-4776-b4c6-797c6214c1a9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:18.197657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 977/1972] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:44:18 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:44:18.198287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b1d2f-a151-4413-8928-f2f7531884f2 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:18.210007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b1d2f-a151-4413-8928-f2f7531884f2 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:18.285832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df960-5e35-415a-ba53-6007cf82f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:18.286466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df960-5e35-415a-ba53-6007cf82f559 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:18.286736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df960-5e35-415a-ba53-6007cf82f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:18.287044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df960-5e35-415a-ba53-6007cf82f559 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:18.287687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4df960-5e35-415a-ba53-6007cf82f559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:18.290401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4df960-5e35-415a-ba53-6007cf82f559 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:18.335685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 996/1973] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:44:18 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:44:18.338282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5c911-2089-4776-b4c6-797c6214c1a9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:18.359041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5c911-2089-4776-b4c6-797c6214c1a9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:18.364294 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26634d-32ca-432b-8f3f-32558a618612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:18.364913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26634d-32ca-432b-8f3f-32558a618612 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:18.365191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26634d-32ca-432b-8f3f-32558a618612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:18.365463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26634d-32ca-432b-8f3f-32558a618612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:18.366156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26634d-32ca-432b-8f3f-32558a618612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:18.367783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26634d-32ca-432b-8f3f-32558a618612 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:18.392569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 978/1974] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:18.397795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df960-5e35-415a-ba53-6007cf82f559 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:18.410498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df960-5e35-415a-ba53-6007cf82f559 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:18.416243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aba9d-f348-41ba-a599-bc607b022e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:18.416920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aba9d-f348-41ba-a599-bc607b022e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:18.417197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aba9d-f348-41ba-a599-bc607b022e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:18.417460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aba9d-f348-41ba-a599-bc607b022e8a admin admin] PATH_INFO: `/v3/projects/c308157263054abf8432fe81bf9c5e3d/users/0ed41516c04c46bb8fd506e069a0fb04/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:18.439902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aba9d-f348-41ba-a599-bc607b022e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c308157263054abf8432fe81bf9c5e3d, user_id=0ed41516c04c46bb8fd506e069a0fb04, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:18.443114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aba9d-f348-41ba-a599-bc607b022e8a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:18.476666 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 997/1975] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:18 2022] PUT /identity/v3/projects/c308157263054abf8432fe81bf9c5e3d/users/0ed41516c04c46bb8fd506e069a0fb04/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:18.480116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26634d-32ca-432b-8f3f-32558a618612 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:18.493229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26634d-32ca-432b-8f3f-32558a618612 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:18.642687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225aaf0-75d2-49cc-9fe8-5fdb6d5b9688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:18.643345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225aaf0-75d2-49cc-9fe8-5fdb6d5b9688 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:18.643621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225aaf0-75d2-49cc-9fe8-5fdb6d5b9688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:18.644040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225aaf0-75d2-49cc-9fe8-5fdb6d5b9688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:18.644700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225aaf0-75d2-49cc-9fe8-5fdb6d5b9688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:18.646895 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225aaf0-75d2-49cc-9fe8-5fdb6d5b9688 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:18.659883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 979/1976] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:44:18.664813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aba9d-f348-41ba-a599-bc607b022e8a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:18.690075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aba9d-f348-41ba-a599-bc607b022e8a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:18.723788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5d990-3490-44ab-b048-6a91ec5015f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:18.724535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5d990-3490-44ab-b048-6a91ec5015f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:18.724797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5d990-3490-44ab-b048-6a91ec5015f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:18.725200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5d990-3490-44ab-b048-6a91ec5015f8 admin admin] PATH_INFO: `/v3/projects/c308157263054abf8432fe81bf9c5e3d/users/0ed41516c04c46bb8fd506e069a0fb04/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:18.727511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5d990-3490-44ab-b048-6a91ec5015f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c308157263054abf8432fe81bf9c5e3d, user_id=0ed41516c04c46bb8fd506e069a0fb04, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:18.730303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5d990-3490-44ab-b048-6a91ec5015f8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:18.744776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 998/1977] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:44:18 2022] PUT /identity/v3/projects/c308157263054abf8432fe81bf9c5e3d/users/0ed41516c04c46bb8fd506e069a0fb04/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:20.126344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f827d-e538-4ff5-9ada-5f5ac78c2442 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:20.126970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f827d-e538-4ff5-9ada-5f5ac78c2442 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:20.126970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f827d-e538-4ff5-9ada-5f5ac78c2442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:20.149553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:20.158939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-289f827d-e538-4ff5-9ada-5f5ac78c2442 None None] MFA Rules not processed for user `0ed41516c04c46bb8fd506e069a0fb04`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:20.160614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-289f827d-e538-4ff5-9ada-5f5ac78c2442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:20.237541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 980/1978] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:20.248281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31098238-7586-4da9-ba30-d59c99a06d01 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:20.248799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31098238-7586-4da9-ba30-d59c99a06d01 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:20.248799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31098238-7586-4da9-ba30-d59c99a06d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:20.269868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-31098238-7586-4da9-ba30-d59c99a06d01 None None] MFA Rules not processed for user `68ae0186d21247bea602cf37cebeac63`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:20.271120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-31098238-7586-4da9-ba30-d59c99a06d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:20.290609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:20.331119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 999/1979] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:20.342596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f827d-e538-4ff5-9ada-5f5ac78c2442 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:20.344393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-289f827d-e538-4ff5-9ada-5f5ac78c2442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:20.424232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f827d-e538-4ff5-9ada-5f5ac78c2442 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:20.430205 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9ce29-00bc-4922-a930-0f569cf93e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:20.430811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9ce29-00bc-4922-a930-0f569cf93e8c service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:20.431114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9ce29-00bc-4922-a930-0f569cf93e8c service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:20.431384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9ce29-00bc-4922-a930-0f569cf93e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:20.439388 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9ce29-00bc-4922-a930-0f569cf93e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:20.440969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9ce29-00bc-4922-a930-0f569cf93e8c service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:20.449934 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 981/1980] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:30.323166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=14 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:30.446212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=63 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:41.964383 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31098238-7586-4da9-ba30-d59c99a06d01 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:42.023679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31098238-7586-4da9-ba30-d59c99a06d01 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:42.027282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:42.027936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:42.028279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:42.028620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:42.030434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:42.097143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:42.098650 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:42.114118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1000/1981] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:44.936401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818a00-4353-4ffb-8df8-609fcf73c05f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:44.936965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818a00-4353-4ffb-8df8-609fcf73c05f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:44.936965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818a00-4353-4ffb-8df8-609fcf73c05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:44.987258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-98818a00-4353-4ffb-8df8-609fcf73c05f None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:44.988813 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-98818a00-4353-4ffb-8df8-609fcf73c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:45.093313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 982/1982] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:44:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:45.128487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:45.130184 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:45.236419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f74ba1-e98e-4613-8ff3-3bb0d5583790 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:45.241657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab94636-2107-4b56-ab29-6dad5e22eca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:45.242286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab94636-2107-4b56-ab29-6dad5e22eca6 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:45.242566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab94636-2107-4b56-ab29-6dad5e22eca6 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:45.242827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab94636-2107-4b56-ab29-6dad5e22eca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:45.251795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab94636-2107-4b56-ab29-6dad5e22eca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:45.253460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab94636-2107-4b56-ab29-6dad5e22eca6 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:45.266573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1001/1983] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:44:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:44:45.837024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f675-2f58-4eb2-96bb-57de5706f830 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:45.837302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f675-2f58-4eb2-96bb-57de5706f830 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:45.837569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f675-2f58-4eb2-96bb-57de5706f830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:45.857533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-72e2f675-2f58-4eb2-96bb-57de5706f830 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:45.858729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-72e2f675-2f58-4eb2-96bb-57de5706f830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:45.867064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 983/1984] 10.222.0.46 () {58 vars in 967 bytes} [Mon Oct 24 13:44:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:45.880419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab94636-2107-4b56-ab29-6dad5e22eca6 service swift] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:45.891613 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab94636-2107-4b56-ab29-6dad5e22eca6 service swift] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:45.897109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dd35b-42f8-4516-b5ff-1809a13b0f52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:45.897731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dd35b-42f8-4516-b5ff-1809a13b0f52 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:45.898011 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dd35b-42f8-4516-b5ff-1809a13b0f52 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:45.898282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dd35b-42f8-4516-b5ff-1809a13b0f52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:45.910788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dd35b-42f8-4516-b5ff-1809a13b0f52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:45.912582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dd35b-42f8-4516-b5ff-1809a13b0f52 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:45.924063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1002/1985] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:44:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:44:46.297724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44309f9-0877-4829-834d-b25f22d92128 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:46.298524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44309f9-0877-4829-834d-b25f22d92128 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:46.298797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44309f9-0877-4829-834d-b25f22d92128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:46.324086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c44309f9-0877-4829-834d-b25f22d92128 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:46.325500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c44309f9-0877-4829-834d-b25f22d92128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:46.356380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 984/1986] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:46.356760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dd35b-42f8-4516-b5ff-1809a13b0f52 service swift] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:46.379207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dd35b-42f8-4516-b5ff-1809a13b0f52 service swift] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:46.379207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf16594-d8e7-464d-8ead-d8fd9e096ea9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:46.379207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf16594-d8e7-464d-8ead-d8fd9e096ea9 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:46.379207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf16594-d8e7-464d-8ead-d8fd9e096ea9 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:46.379587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf16594-d8e7-464d-8ead-d8fd9e096ea9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:46.397132 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf16594-d8e7-464d-8ead-d8fd9e096ea9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:46.399389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf16594-d8e7-464d-8ead-d8fd9e096ea9 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:46.412101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1003/1987] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:44:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:44:46.462422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44309f9-0877-4829-834d-b25f22d92128 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:46.463858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c44309f9-0877-4829-834d-b25f22d92128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:46.554082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44309f9-0877-4829-834d-b25f22d92128 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:46.560483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321bb2d-2a91-4476-b41d-433d994571bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:46.561508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321bb2d-2a91-4476-b41d-433d994571bf service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:46.561879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321bb2d-2a91-4476-b41d-433d994571bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:46.562339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321bb2d-2a91-4476-b41d-433d994571bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:46.574973 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321bb2d-2a91-4476-b41d-433d994571bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:46.576911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321bb2d-2a91-4476-b41d-433d994571bf service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:46.591903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 985/1988] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:46.831898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e836d-056f-46ea-bb3c-04236508912e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:46.832184 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e836d-056f-46ea-bb3c-04236508912e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:46.832456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e836d-056f-46ea-bb3c-04236508912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:46.853962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-064e836d-056f-46ea-bb3c-04236508912e None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:46.855202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-064e836d-056f-46ea-bb3c-04236508912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:46.862675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1004/1989] 10.222.0.46 () {58 vars in 967 bytes} [Mon Oct 24 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:46.875112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321bb2d-2a91-4476-b41d-433d994571bf service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:46.886380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321bb2d-2a91-4476-b41d-433d994571bf service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:46.891642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fd95c-2673-468d-8981-b7aedb554d38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:46.892342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fd95c-2673-468d-8981-b7aedb554d38 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:46.892552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fd95c-2673-468d-8981-b7aedb554d38 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:46.892858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fd95c-2673-468d-8981-b7aedb554d38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:46.902181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fd95c-2673-468d-8981-b7aedb554d38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:46.903876 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fd95c-2673-468d-8981-b7aedb554d38 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:46.913365 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 986/1990] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:44:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:44:49.067394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e836d-056f-46ea-bb3c-04236508912e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:49.068941 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-064e836d-056f-46ea-bb3c-04236508912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:49.080122 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:49.141029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e836d-056f-46ea-bb3c-04236508912e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:49.146033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:49.146704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:49.146995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:49.147285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] PATH_INFO: `/v3/users/4fb5ff0d31f6499db6b1dc73e458ea14` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:49.148454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb5ff0d31f6499db6b1dc73e458ea14)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:49.150398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:49.201714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb5ff0d31f6499db6b1dc73e458ea14'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.202355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb5ff0d31f6499db6b1dc73e458ea14'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.210059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb5ff0d31f6499db6b1dc73e458ea14'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.223869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb5ff0d31f6499db6b1dc73e458ea14'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.224830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb5ff0d31f6499db6b1dc73e458ea14'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.240008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1005/1991] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:44:49 2022] DELETE /identity/v3/users/4fb5ff0d31f6499db6b1dc73e458ea14 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:49.244679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58bf5a-6501-4c99-bcc3-cf3763dc7672 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:49.245178 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58bf5a-6501-4c99-bcc3-cf3763dc7672 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:49.245273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58bf5a-6501-4c99-bcc3-cf3763dc7672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:49.266966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ad58bf5a-6501-4c99-bcc3-cf3763dc7672 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:44:49.268201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ad58bf5a-6501-4c99-bcc3-cf3763dc7672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:49.337521 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 987/1992] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:44:49.348358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:49.350090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:49.414981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccfc93-fc0d-48f6-8994-f53fd736618c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:49.418727 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a0696-473a-4f4a-8972-6179dc4e82c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:49.419992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a0696-473a-4f4a-8972-6179dc4e82c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:49.419992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a0696-473a-4f4a-8972-6179dc4e82c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:49.420693 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a0696-473a-4f4a-8972-6179dc4e82c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:49.430630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a0696-473a-4f4a-8972-6179dc4e82c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:49.432196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a0696-473a-4f4a-8972-6179dc4e82c2 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:49.442311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1006/1993] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:44:49.627541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58bf5a-6501-4c99-bcc3-cf3763dc7672 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:44:49.629584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ad58bf5a-6501-4c99-bcc3-cf3763dc7672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:44:49.644581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58bf5a-6501-4c99-bcc3-cf3763dc7672 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:44:49.650495 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:44:49.651299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:44:49.651704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:44:49.651982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] PATH_INFO: `/v3/projects/f0e2432d95414c9b9186dafcb5a94a98` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:44:49.654387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e2432d95414c9b9186dafcb5a94a98)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:44:49.656468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:44:49.675765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:49.709327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e2432d95414c9b9186dafcb5a94a98', 'request_id': 'req-e6d73c7f-ea02-41f4-be77-bad9a3b24944'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.717261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e2432d95414c9b9186dafcb5a94a98', 'request_id': 'req-e6d73c7f-ea02-41f4-be77-bad9a3b24944'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.724300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e2432d95414c9b9186dafcb5a94a98', 'request_id': 'req-e6d73c7f-ea02-41f4-be77-bad9a3b24944'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.742717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] The token cache is being invalidate because project f0e2432d95414c9b9186dafcb5a94a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:44:49.743113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.743982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:44:49.753722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 988/1994] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:44:49 2022] DELETE /identity/v3/projects/f0e2432d95414c9b9186dafcb5a94a98 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:44:59.437752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=76,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:59.739532 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:04.900799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f907c-55a6-4321-98da-6e5f1e7fc046 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:04.901748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f907c-55a6-4321-98da-6e5f1e7fc046 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:04.902164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f907c-55a6-4321-98da-6e5f1e7fc046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:04.923022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bd4f907c-55a6-4321-98da-6e5f1e7fc046 None None] MFA Rules not processed for user `6414c4b3a3ca4d4bab67712790abff00`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:04.924248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bd4f907c-55a6-4321-98da-6e5f1e7fc046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:04.983825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1007/1995] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:45:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:45:06.629653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:06.631222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:06.701381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d73c7f-ea02-41f4-be77-bad9a3b24944 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:06.706465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:06.707169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:06.707415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:06.707663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] PATH_INFO: `/v3/users/68ae0186d21247bea602cf37cebeac63` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:06.708815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ae0186d21247bea602cf37cebeac63)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:06.710731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:06.761057 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ae0186d21247bea602cf37cebeac63'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:06.761715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ae0186d21247bea602cf37cebeac63'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:06.769380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ae0186d21247bea602cf37cebeac63'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:06.782553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ae0186d21247bea602cf37cebeac63'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:06.783275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ae0186d21247bea602cf37cebeac63'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:06.797596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 989/1996] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:45:06 2022] DELETE /identity/v3/users/68ae0186d21247bea602cf37cebeac63 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:06.990052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f907c-55a6-4321-98da-6e5f1e7fc046 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:07.015026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f907c-55a6-4321-98da-6e5f1e7fc046 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:07.087362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:07.088035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:07.088460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:07.088756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] PATH_INFO: `/v3/projects/9a4a162b9b0348af85a6a2258d3acc50` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:07.089899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4a162b9b0348af85a6a2258d3acc50)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:07.092052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:07.164648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4a162b9b0348af85a6a2258d3acc50', 'request_id': 'req-eed84613-b9b7-47e7-8477-7ca97f84aed6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.176814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4a162b9b0348af85a6a2258d3acc50', 'request_id': 'req-eed84613-b9b7-47e7-8477-7ca97f84aed6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.184440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4a162b9b0348af85a6a2258d3acc50', 'request_id': 'req-eed84613-b9b7-47e7-8477-7ca97f84aed6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.198388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] The token cache is being invalidate because project 9a4a162b9b0348af85a6a2258d3acc50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:45:07.198674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.199322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.200846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1008/1997] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:45:06 2022] DELETE /identity/v3/projects/9a4a162b9b0348af85a6a2258d3acc50 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:07.204959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:07.206386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:07.219609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b904f-667e-4b15-8662-284d62c5cc0a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:07.288285 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:07.289479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:07.289756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:07.290021 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] PATH_INFO: `/v3/users/0ed41516c04c46bb8fd506e069a0fb04` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:07.291441 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed41516c04c46bb8fd506e069a0fb04)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:07.293514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:07.319085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:07.357016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed41516c04c46bb8fd506e069a0fb04'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.358116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed41516c04c46bb8fd506e069a0fb04'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.367428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed41516c04c46bb8fd506e069a0fb04'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.384008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed41516c04c46bb8fd506e069a0fb04'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.385119 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-10c711d5-9bf2-4346-aa43-18e2a820874f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed41516c04c46bb8fd506e069a0fb04'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.402637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 990/1998] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:45:07 2022] DELETE /identity/v3/users/0ed41516c04c46bb8fd506e069a0fb04 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:45:07.756589 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:07.758339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:07.771892 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84613-b9b7-47e7-8477-7ca97f84aed6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:07.809533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:07.840129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:07.841102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:07.843048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:07.843048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] PATH_INFO: `/v3/projects/c308157263054abf8432fe81bf9c5e3d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:07.845782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c308157263054abf8432fe81bf9c5e3d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:07.846128 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:07.902664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c308157263054abf8432fe81bf9c5e3d', 'request_id': 'req-20623e01-27f8-4556-9779-d15f0062f086'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.911939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c308157263054abf8432fe81bf9c5e3d', 'request_id': 'req-20623e01-27f8-4556-9779-d15f0062f086'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.919842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c308157263054abf8432fe81bf9c5e3d', 'request_id': 'req-20623e01-27f8-4556-9779-d15f0062f086'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.937882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] The token cache is being invalidate because project c308157263054abf8432fe81bf9c5e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:45:07.938277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.939037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-20623e01-27f8-4556-9779-d15f0062f086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:07.944287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1009/1999] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:45:07 2022] DELETE /identity/v3/projects/c308157263054abf8432fe81bf9c5e3d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:07.946034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1dd67-8c18-49e4-8eca-9525777d23e2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:07.946513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1dd67-8c18-49e4-8eca-9525777d23e2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:07.946646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1dd67-8c18-49e4-8eca-9525777d23e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:07.974161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d8d1dd67-8c18-49e4-8eca-9525777d23e2 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:07.975448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d8d1dd67-8c18-49e4-8eca-9525777d23e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:08.059836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 991/2000] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:45:08.061426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25816ce8-9dfc-4ef1-af99-cb63719b2ad4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.061940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25816ce8-9dfc-4ef1-af99-cb63719b2ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.062044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25816ce8-9dfc-4ef1-af99-cb63719b2ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.084453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-25816ce8-9dfc-4ef1-af99-cb63719b2ad4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:08.086181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-25816ce8-9dfc-4ef1-af99-cb63719b2ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:08.095105 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1010/2001] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:45:08.099157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1dd67-8c18-49e4-8eca-9525777d23e2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.109006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1dd67-8c18-49e4-8eca-9525777d23e2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.115101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd377c07-9a60-4c22-b629-f6e3b1dee656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.115713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd377c07-9a60-4c22-b629-f6e3b1dee656 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.115988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd377c07-9a60-4c22-b629-f6e3b1dee656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.116256 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd377c07-9a60-4c22-b629-f6e3b1dee656 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.116940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd377c07-9a60-4c22-b629-f6e3b1dee656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:45:08.117242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd377c07-9a60-4c22-b629-f6e3b1dee656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.118830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd377c07-9a60-4c22-b629-f6e3b1dee656 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.130737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 992/2002] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:45:08.135431 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25816ce8-9dfc-4ef1-af99-cb63719b2ad4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.145148 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25816ce8-9dfc-4ef1-af99-cb63719b2ad4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.150227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de134d2-6a60-4a54-99bb-4994fc1d79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.150717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de134d2-6a60-4a54-99bb-4994fc1d79d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.151097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de134d2-6a60-4a54-99bb-4994fc1d79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.151417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de134d2-6a60-4a54-99bb-4994fc1d79d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.152127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de134d2-6a60-4a54-99bb-4994fc1d79d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.154111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de134d2-6a60-4a54-99bb-4994fc1d79d0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.186442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1011/2003] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:45:08 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:45:08.190514 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd377c07-9a60-4c22-b629-f6e3b1dee656 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.200938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd377c07-9a60-4c22-b629-f6e3b1dee656 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.260448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bca10c-e6e6-4b57-bea0-3b28e9b57f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.260959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bca10c-e6e6-4b57-bea0-3b28e9b57f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.261231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bca10c-e6e6-4b57-bea0-3b28e9b57f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.261494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bca10c-e6e6-4b57-bea0-3b28e9b57f4e admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.262471 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bca10c-e6e6-4b57-bea0-3b28e9b57f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.264401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bca10c-e6e6-4b57-bea0-3b28e9b57f4e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.290123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 993/2004] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:45:08 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:45:08.291476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de134d2-6a60-4a54-99bb-4994fc1d79d0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.301606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de134d2-6a60-4a54-99bb-4994fc1d79d0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.307579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3f92-7615-408c-9cf4-9a30cca41b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.308185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3f92-7615-408c-9cf4-9a30cca41b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.308456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3f92-7615-408c-9cf4-9a30cca41b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.308720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3f92-7615-408c-9cf4-9a30cca41b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.309380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae3f92-7615-408c-9cf4-9a30cca41b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.311723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae3f92-7615-408c-9cf4-9a30cca41b42 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.322750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1012/2005] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:45:08.326837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bca10c-e6e6-4b57-bea0-3b28e9b57f4e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.337427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bca10c-e6e6-4b57-bea0-3b28e9b57f4e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.342589 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c54bc-5c3f-42b3-a167-c57c85c2a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.343327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c54bc-5c3f-42b3-a167-c57c85c2a345 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.343693 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c54bc-5c3f-42b3-a167-c57c85c2a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.343962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c54bc-5c3f-42b3-a167-c57c85c2a345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.344601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c54bc-5c3f-42b3-a167-c57c85c2a345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.346218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c54bc-5c3f-42b3-a167-c57c85c2a345 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.357405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 994/2006] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:45:08.361668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3f92-7615-408c-9cf4-9a30cca41b42 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.389751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3f92-7615-408c-9cf4-9a30cca41b42 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.394429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ec05-8fef-4504-b264-92f9e404bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.395244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ec05-8fef-4504-b264-92f9e404bbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.395584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ec05-8fef-4504-b264-92f9e404bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.395918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ec05-8fef-4504-b264-92f9e404bbe3 admin admin] PATH_INFO: `/v3/projects/c0309ab13c4c494e82b0a150f5b4a29c/users/2f44161340814f55b8fc09cc477b8583/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.412858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9ec05-8fef-4504-b264-92f9e404bbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0309ab13c4c494e82b0a150f5b4a29c, user_id=2f44161340814f55b8fc09cc477b8583, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.415632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9ec05-8fef-4504-b264-92f9e404bbe3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.432436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1013/2007] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:45:08 2022] PUT /identity/v3/projects/c0309ab13c4c494e82b0a150f5b4a29c/users/2f44161340814f55b8fc09cc477b8583/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:08.442753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600712c-9178-42fc-9a71-27e7d9feae98 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.443070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600712c-9178-42fc-9a71-27e7d9feae98 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.443339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600712c-9178-42fc-9a71-27e7d9feae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.452345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:08.474917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4600712c-9178-42fc-9a71-27e7d9feae98 None None] MFA Rules not processed for user `2f44161340814f55b8fc09cc477b8583`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:08.476845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4600712c-9178-42fc-9a71-27e7d9feae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:08.559132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 995/2008] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:45:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:45:08.562846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ec05-8fef-4504-b264-92f9e404bbe3 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.626146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ec05-8fef-4504-b264-92f9e404bbe3 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.630813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001489fc-ca4c-43aa-93f0-459b5644b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.631554 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001489fc-ca4c-43aa-93f0-459b5644b0ec admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.631834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001489fc-ca4c-43aa-93f0-459b5644b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.632102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001489fc-ca4c-43aa-93f0-459b5644b0ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.633023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001489fc-ca4c-43aa-93f0-459b5644b0ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.635008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001489fc-ca4c-43aa-93f0-459b5644b0ec admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.640893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:08.670610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1014/2009] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:45:08 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:45:08.672136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600712c-9178-42fc-9a71-27e7d9feae98 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.684270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600712c-9178-42fc-9a71-27e7d9feae98 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.744982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950dc5-4293-4291-9233-f635c2b7e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.745715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950dc5-4293-4291-9233-f635c2b7e246 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.745989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950dc5-4293-4291-9233-f635c2b7e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.746442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950dc5-4293-4291-9233-f635c2b7e246 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.747029 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf950dc5-4293-4291-9233-f635c2b7e246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.748961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf950dc5-4293-4291-9233-f635c2b7e246 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.790320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 996/2010] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:45:08 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:45:08.796127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001489fc-ca4c-43aa-93f0-459b5644b0ec admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.814891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001489fc-ca4c-43aa-93f0-459b5644b0ec admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.819935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d3f08-401b-450d-bf6e-367c0198e4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.820596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d3f08-401b-450d-bf6e-367c0198e4dd admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.820895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d3f08-401b-450d-bf6e-367c0198e4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.821153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d3f08-401b-450d-bf6e-367c0198e4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.822132 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d3f08-401b-450d-bf6e-367c0198e4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.823835 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d3f08-401b-450d-bf6e-367c0198e4dd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.834289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1015/2011] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:45:08.838691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950dc5-4293-4291-9233-f635c2b7e246 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.848714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950dc5-4293-4291-9233-f635c2b7e246 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.853424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da48e17-cd7a-44a0-bb79-9c03407ce607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.854090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da48e17-cd7a-44a0-bb79-9c03407ce607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.854364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da48e17-cd7a-44a0-bb79-9c03407ce607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.854627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da48e17-cd7a-44a0-bb79-9c03407ce607 admin admin] PATH_INFO: `/v3/projects/7637da5cfe0a4ef2b51d727bbe8aba8b/users/19c0dd1e6e26435982de8023f387eaad/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.870736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da48e17-cd7a-44a0-bb79-9c03407ce607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7637da5cfe0a4ef2b51d727bbe8aba8b, user_id=19c0dd1e6e26435982de8023f387eaad, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.873411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da48e17-cd7a-44a0-bb79-9c03407ce607 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.890136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 997/2012] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:45:08 2022] PUT /identity/v3/projects/7637da5cfe0a4ef2b51d727bbe8aba8b/users/19c0dd1e6e26435982de8023f387eaad/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:08.894441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d3f08-401b-450d-bf6e-367c0198e4dd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.904822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d3f08-401b-450d-bf6e-367c0198e4dd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.963412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a836eb5-1ffe-4516-8e9e-9b2af3921409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.964022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a836eb5-1ffe-4516-8e9e-9b2af3921409 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.964323 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a836eb5-1ffe-4516-8e9e-9b2af3921409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.964588 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a836eb5-1ffe-4516-8e9e-9b2af3921409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:08.965228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a836eb5-1ffe-4516-8e9e-9b2af3921409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:08.966861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a836eb5-1ffe-4516-8e9e-9b2af3921409 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:08.977416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1016/2013] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:45:08.981616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da48e17-cd7a-44a0-bb79-9c03407ce607 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:08.992478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da48e17-cd7a-44a0-bb79-9c03407ce607 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:08.997424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bb361-193b-4e3d-9623-9d57451a4afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:08.998089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bb361-193b-4e3d-9623-9d57451a4afc admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:08.998364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bb361-193b-4e3d-9623-9d57451a4afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:08.998633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bb361-193b-4e3d-9623-9d57451a4afc admin admin] PATH_INFO: `/v3/projects/7637da5cfe0a4ef2b51d727bbe8aba8b/users/19c0dd1e6e26435982de8023f387eaad/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:09.000622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bb361-193b-4e3d-9623-9d57451a4afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7637da5cfe0a4ef2b51d727bbe8aba8b, user_id=19c0dd1e6e26435982de8023f387eaad, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:09.003323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bb361-193b-4e3d-9623-9d57451a4afc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:09.014655 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 998/2014] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:45:08 2022] PUT /identity/v3/projects/7637da5cfe0a4ef2b51d727bbe8aba8b/users/19c0dd1e6e26435982de8023f387eaad/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:09.026231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523140f1-5cb5-496d-9b52-1f79ab4df77b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:09.026457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523140f1-5cb5-496d-9b52-1f79ab4df77b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:09.026731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523140f1-5cb5-496d-9b52-1f79ab4df77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:09.075177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-523140f1-5cb5-496d-9b52-1f79ab4df77b None None] MFA Rules not processed for user `19c0dd1e6e26435982de8023f387eaad`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:09.076494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-523140f1-5cb5-496d-9b52-1f79ab4df77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:09.158887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1017/2015] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:45:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:45:09.166357 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bb361-193b-4e3d-9623-9d57451a4afc admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:09.168537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-595bb361-193b-4e3d-9623-9d57451a4afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:09.225517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:09.232111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bb361-193b-4e3d-9623-9d57451a4afc admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:09.238239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a70cb-5016-4c3f-8854-54c8bc346f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:09.238962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a70cb-5016-4c3f-8854-54c8bc346f10 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:09.239714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a70cb-5016-4c3f-8854-54c8bc346f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:09.240080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a70cb-5016-4c3f-8854-54c8bc346f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:09.311934 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a70cb-5016-4c3f-8854-54c8bc346f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:09.313482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a70cb-5016-4c3f-8854-54c8bc346f10 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:09.324727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 999/2016] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:45:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:45:13.647154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523140f1-5cb5-496d-9b52-1f79ab4df77b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:13.648966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-523140f1-5cb5-496d-9b52-1f79ab4df77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:13.662341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523140f1-5cb5-496d-9b52-1f79ab4df77b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:13.666949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4eb2e0-6c06-49b2-8fa6-618872d4819a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:13.667636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4eb2e0-6c06-49b2-8fa6-618872d4819a service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:13.667911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4eb2e0-6c06-49b2-8fa6-618872d4819a service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:13.668172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4eb2e0-6c06-49b2-8fa6-618872d4819a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:13.677766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4eb2e0-6c06-49b2-8fa6-618872d4819a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:13.679252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4eb2e0-6c06-49b2-8fa6-618872d4819a service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:13.688793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1018/2017] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:45:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:45:15.437156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a70cb-5016-4c3f-8854-54c8bc346f10 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:15.438805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-915a70cb-5016-4c3f-8854-54c8bc346f10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:15.511409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a70cb-5016-4c3f-8854-54c8bc346f10 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:15.516880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c076a-57a7-45fc-9aab-fdb109dcca64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:15.517591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c076a-57a7-45fc-9aab-fdb109dcca64 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:15.517907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c076a-57a7-45fc-9aab-fdb109dcca64 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:15.518149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c076a-57a7-45fc-9aab-fdb109dcca64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:15.519981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-609c076a-57a7-45fc-9aab-fdb109dcca64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:15.532567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c076a-57a7-45fc-9aab-fdb109dcca64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:15.534150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c076a-57a7-45fc-9aab-fdb109dcca64 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:15.544585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1000/2018] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:45:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:45:18.760629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4eb2e0-6c06-49b2-8fa6-618872d4819a service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:18.809808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:18.829368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4eb2e0-6c06-49b2-8fa6-618872d4819a service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:18.834402 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:18.835059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:18.835330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:18.835592 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] PATH_INFO: `/v3/users/2f44161340814f55b8fc09cc477b8583` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:18.836720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f44161340814f55b8fc09cc477b8583)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:18.838721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:18.892152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f44161340814f55b8fc09cc477b8583'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:18.892843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f44161340814f55b8fc09cc477b8583'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:18.901143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f44161340814f55b8fc09cc477b8583'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:18.914247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f44161340814f55b8fc09cc477b8583'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:18.915153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f44161340814f55b8fc09cc477b8583'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:18.932412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1019/2019] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:45:18 2022] DELETE /identity/v3/users/2f44161340814f55b8fc09cc477b8583 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:18.937335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812616ae-da5f-424c-b3b2-4bcc666a21e0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:18.937804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812616ae-da5f-424c-b3b2-4bcc666a21e0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:18.937897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812616ae-da5f-424c-b3b2-4bcc666a21e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:18.961518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-812616ae-da5f-424c-b3b2-4bcc666a21e0 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:18.962822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-812616ae-da5f-424c-b3b2-4bcc666a21e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:19.033956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1001/2020] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:45:19.048347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:19.049789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:19.107540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ec055-922a-4e78-83fe-1dd822f7cf41 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:19.111216 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e38b2-d124-4951-a9fb-26ca6ebeb244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:19.111836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e38b2-d124-4951-a9fb-26ca6ebeb244 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:19.112108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e38b2-d124-4951-a9fb-26ca6ebeb244 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:19.112376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e38b2-d124-4951-a9fb-26ca6ebeb244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:19.122452 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e38b2-d124-4951-a9fb-26ca6ebeb244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:19.124086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e38b2-d124-4951-a9fb-26ca6ebeb244 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:19.136519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1020/2021] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:45:19.441877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812616ae-da5f-424c-b3b2-4bcc666a21e0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:19.443834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-812616ae-da5f-424c-b3b2-4bcc666a21e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:19.463936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812616ae-da5f-424c-b3b2-4bcc666a21e0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:19.470700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:19.471409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:19.471650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:19.471916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] PATH_INFO: `/v3/projects/c0309ab13c4c494e82b0a150f5b4a29c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:19.473089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0309ab13c4c494e82b0a150f5b4a29c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:19.475033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:19.509322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:19.526709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0309ab13c4c494e82b0a150f5b4a29c', 'request_id': 'req-6f1107ef-5e52-4916-8d37-6a43a4177108'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.533214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0309ab13c4c494e82b0a150f5b4a29c', 'request_id': 'req-6f1107ef-5e52-4916-8d37-6a43a4177108'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.538986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0309ab13c4c494e82b0a150f5b4a29c', 'request_id': 'req-6f1107ef-5e52-4916-8d37-6a43a4177108'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.553414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] The token cache is being invalidate because project c0309ab13c4c494e82b0a150f5b4a29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:45:19.553782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.554374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.555949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1002/2022] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:45:19 2022] DELETE /identity/v3/projects/c0309ab13c4c494e82b0a150f5b4a29c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:19.560182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e38b2-d124-4951-a9fb-26ca6ebeb244 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:19.570320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e38b2-d124-4951-a9fb-26ca6ebeb244 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:19.637281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:19.638039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:19.638405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:19.638739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] PATH_INFO: `/v3/users/19c0dd1e6e26435982de8023f387eaad` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:19.639932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c0dd1e6e26435982de8023f387eaad)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:19.641970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:19.647405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:19.691059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c0dd1e6e26435982de8023f387eaad'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.691712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c0dd1e6e26435982de8023f387eaad'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.699077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c0dd1e6e26435982de8023f387eaad'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.711850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c0dd1e6e26435982de8023f387eaad'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.712569 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3c5794d6-ec96-4695-9e15-37c1fa117b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c0dd1e6e26435982de8023f387eaad'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:19.727998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1021/2023] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:45:19 2022] DELETE /identity/v3/users/19c0dd1e6e26435982de8023f387eaad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:20.009580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:20.012216 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:20.025717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1107ef-5e52-4916-8d37-6a43a4177108 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:20.086272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:20.086830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:20.087264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:20.087425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] PATH_INFO: `/v3/projects/7637da5cfe0a4ef2b51d727bbe8aba8b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:20.089064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7637da5cfe0a4ef2b51d727bbe8aba8b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:20.090528 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:20.142881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7637da5cfe0a4ef2b51d727bbe8aba8b', 'request_id': 'req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:20.149445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7637da5cfe0a4ef2b51d727bbe8aba8b', 'request_id': 'req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:20.156233 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7637da5cfe0a4ef2b51d727bbe8aba8b', 'request_id': 'req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:20.176595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] The token cache is being invalidate because project 7637da5cfe0a4ef2b51d727bbe8aba8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:45:20.177648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:20.178302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:45:20.180031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1003/2024] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:45:20 2022] DELETE /identity/v3/projects/7637da5cfe0a4ef2b51d727bbe8aba8b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:45:29.724215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:30.172721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:32.154416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efe08-6e0e-4964-916a-9ec4d070c804 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:32.155284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efe08-6e0e-4964-916a-9ec4d070c804 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:32.155284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efe08-6e0e-4964-916a-9ec4d070c804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:32.174512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b11efe08-6e0e-4964-916a-9ec4d070c804 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:32.175735 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b11efe08-6e0e-4964-916a-9ec4d070c804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:32.233411 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1022/2025] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:45:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:45:32.245927 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:32.247439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:32.318313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde17d2-f3cc-4762-ad1e-8e1631a2c3fd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:32.323829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe2b4a-2b48-49d5-88a3-a5ddafb747ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:32.324439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe2b4a-2b48-49d5-88a3-a5ddafb747ce service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:32.324712 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe2b4a-2b48-49d5-88a3-a5ddafb747ce service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:32.324980 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe2b4a-2b48-49d5-88a3-a5ddafb747ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:32.337957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe2b4a-2b48-49d5-88a3-a5ddafb747ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:32.341273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe2b4a-2b48-49d5-88a3-a5ddafb747ce service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:32.353835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1004/2026] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:45:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:45:42.226049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=25 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:42.348577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=32 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:46.554310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d99260-7e31-4d39-b94a-ddc029c0b0da None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:46.554905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d99260-7e31-4d39-b94a-ddc029c0b0da None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:46.555031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d99260-7e31-4d39-b94a-ddc029c0b0da None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:46.556432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1023/2027] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:45:46.563026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30287a43-1d54-4357-9775-89df4c6a7df8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:46.563497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30287a43-1d54-4357-9775-89df4c6a7df8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:46.563824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30287a43-1d54-4357-9775-89df4c6a7df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:46.584316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-30287a43-1d54-4357-9775-89df4c6a7df8 None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:46.585610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-30287a43-1d54-4357-9775-89df4c6a7df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:46.653978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1005/2028] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:45:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:45:46.667341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d99260-7e31-4d39-b94a-ddc029c0b0da None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:46.669030 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-85d99260-7e31-4d39-b94a-ddc029c0b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:46.727815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d99260-7e31-4d39-b94a-ddc029c0b0da None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:46.732868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c752d3-eb51-4ba3-b7fb-8932081e9ce7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8ec9210f54c6698477d7dbbe46a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:46.733808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c752d3-eb51-4ba3-b7fb-8932081e9ce7 service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:46.734393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c752d3-eb51-4ba3-b7fb-8932081e9ce7 service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:46.734734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c752d3-eb51-4ba3-b7fb-8932081e9ce7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:46.751137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c752d3-eb51-4ba3-b7fb-8932081e9ce7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:46.752578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c752d3-eb51-4ba3-b7fb-8932081e9ce7 service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:46.764349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1024/2029] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:45:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:45:46.850955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c676d-0e22-4cf6-8d23-daa36d746290 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:46.851192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c676d-0e22-4cf6-8d23-daa36d746290 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:46.851488 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c676d-0e22-4cf6-8d23-daa36d746290 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:46.852871 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1006/2030] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:45:46.860043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5015-382c-4196-ace1-1d85969d2ee4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:46.860307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5015-382c-4196-ace1-1d85969d2ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:46.860573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5015-382c-4196-ace1-1d85969d2ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:46.881798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-407b5015-382c-4196-ace1-1d85969d2ee4 None None] MFA Rules not processed for user `fe801da792944be2b6342c483bcb88b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:46.883008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-407b5015-382c-4196-ace1-1d85969d2ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:46.938779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1025/2031] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:45:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:45:46.950960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c676d-0e22-4cf6-8d23-daa36d746290 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:46.952801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-220c676d-0e22-4cf6-8d23-daa36d746290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:46.966196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c676d-0e22-4cf6-8d23-daa36d746290 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:46.970160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560392-e22c-482e-9715-d6ddd1cf8eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:46.970745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560392-e22c-482e-9715-d6ddd1cf8eee service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:46.971068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560392-e22c-482e-9715-d6ddd1cf8eee service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:46.971316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560392-e22c-482e-9715-d6ddd1cf8eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:46.978205 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560392-e22c-482e-9715-d6ddd1cf8eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:46.979648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560392-e22c-482e-9715-d6ddd1cf8eee service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:46.987278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1007/2032] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:45:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:45:47.081945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade93384-c365-45cf-9bb1-c52ce9864fbd None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:47.082224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade93384-c365-45cf-9bb1-c52ce9864fbd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:47.082489 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade93384-c365-45cf-9bb1-c52ce9864fbd None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:47.083893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1026/2033] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:45:47.092045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e395c8-d6aa-470a-8c9a-45420db03dc4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:47.092337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e395c8-d6aa-470a-8c9a-45420db03dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:47.092601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e395c8-d6aa-470a-8c9a-45420db03dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:47.118566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c5e395c8-d6aa-470a-8c9a-45420db03dc4 None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:47.119821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c5e395c8-d6aa-470a-8c9a-45420db03dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:47.130424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1008/2034] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:45:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:45:47.142048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade93384-c365-45cf-9bb1-c52ce9864fbd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:47.160837 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade93384-c365-45cf-9bb1-c52ce9864fbd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:47.167762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4cc26-bdb2-401f-82ad-dde6726af8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:47.168635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4cc26-bdb2-401f-82ad-dde6726af8ca service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:47.169114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4cc26-bdb2-401f-82ad-dde6726af8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:47.169462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4cc26-bdb2-401f-82ad-dde6726af8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:47.181356 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4cc26-bdb2-401f-82ad-dde6726af8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:47.182801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4cc26-bdb2-401f-82ad-dde6726af8ca service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:47.197340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1027/2035] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:45:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:45:49.797233 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754670da-9cbb-454b-bf93-46e56bc1e465 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:49.797765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754670da-9cbb-454b-bf93-46e56bc1e465 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:49.797765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754670da-9cbb-454b-bf93-46e56bc1e465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:49.818014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-754670da-9cbb-454b-bf93-46e56bc1e465 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:45:49.819254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-754670da-9cbb-454b-bf93-46e56bc1e465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:45:49.826698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1009/2036] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:45:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:45:49.851610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4cc26-bdb2-401f-82ad-dde6726af8ca service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:45:49.866506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4cc26-bdb2-401f-82ad-dde6726af8ca service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:45:49.872393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67a37d-71b8-4394-a74d-4c9b6c4c0912 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:45:49.873010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a37d-71b8-4394-a74d-4c9b6c4c0912 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:45:49.873284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a37d-71b8-4394-a74d-4c9b6c4c0912 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:45:49.873616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a37d-71b8-4394-a74d-4c9b6c4c0912 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:45:49.882186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67a37d-71b8-4394-a74d-4c9b6c4c0912 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:45:49.883799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67a37d-71b8-4394-a74d-4c9b6c4c0912 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:45:49.892080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1028/2037] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:45:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:45:59.812445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=43 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:59.888937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=61 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:15.387273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bccbc-9a4c-4fdc-9678-581780b0ff89 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:46:15.387809 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bccbc-9a4c-4fdc-9678-581780b0ff89 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:46:15.387809 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bccbc-9a4c-4fdc-9678-581780b0ff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:46:15.411314 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bb6bccbc-9a4c-4fdc-9678-581780b0ff89 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:46:15.412582 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bb6bccbc-9a4c-4fdc-9678-581780b0ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:46:15.420816 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1010/2038] 10.222.0.46 () {58 vars in 967 bytes} [Mon Oct 24 13:46:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:46:15.433914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67a37d-71b8-4394-a74d-4c9b6c4c0912 service swift] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:46:15.444558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67a37d-71b8-4394-a74d-4c9b6c4c0912 service swift] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:46:15.449914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78e4bc-1ae5-4b9c-a971-88cfb33f260f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:46:15.450502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78e4bc-1ae5-4b9c-a971-88cfb33f260f service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:46:15.450769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78e4bc-1ae5-4b9c-a971-88cfb33f260f service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:46:15.451071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78e4bc-1ae5-4b9c-a971-88cfb33f260f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:46:15.460093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78e4bc-1ae5-4b9c-a971-88cfb33f260f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:46:15.461726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78e4bc-1ae5-4b9c-a971-88cfb33f260f service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:46:15.469939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1029/2039] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:46:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:46:25.403557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:25.466751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:41.720834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400120f-944b-4f3c-884a-41b76929552b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:46:41.721392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400120f-944b-4f3c-884a-41b76929552b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:46:41.721392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400120f-944b-4f3c-884a-41b76929552b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:46:41.744976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0400120f-944b-4f3c-884a-41b76929552b None None] MFA Rules not processed for user `59706abd14944c648378688abaac199d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:46:41.746175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0400120f-944b-4f3c-884a-41b76929552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:46:41.805586 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1011/2040] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:46:51.797536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=25 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:17.240100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a234-a1b9-4dac-bff4-6154758155fd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:17.240681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a234-a1b9-4dac-bff4-6154758155fd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:17.240681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a234-a1b9-4dac-bff4-6154758155fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:17.261044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5aa2a234-a1b9-4dac-bff4-6154758155fd None None] MFA Rules not processed for user `6414c4b3a3ca4d4bab67712790abff00`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:47:17.262266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5aa2a234-a1b9-4dac-bff4-6154758155fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:17.319152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1030/2041] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:47:17.361851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400120f-944b-4f3c-884a-41b76929552b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:17.363389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0400120f-944b-4f3c-884a-41b76929552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:17.375751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400120f-944b-4f3c-884a-41b76929552b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:17.380145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8ec9210f54c6698477d7dbbe46a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:17.380829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:17.381105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:17.381338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:17.383302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:17.399130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:17.400555 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:17.411756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1012/2042] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:47:19.061472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2a234-a1b9-4dac-bff4-6154758155fd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:19.071961 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2a234-a1b9-4dac-bff4-6154758155fd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:19.075927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c539da-b39e-46cf-b3ce-1b4aafa276bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:19.076523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c539da-b39e-46cf-b3ce-1b4aafa276bb service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:19.076792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c539da-b39e-46cf-b3ce-1b4aafa276bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:19.077046 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c539da-b39e-46cf-b3ce-1b4aafa276bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:19.078871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e6c539da-b39e-46cf-b3ce-1b4aafa276bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:19.093274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c539da-b39e-46cf-b3ce-1b4aafa276bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:19.094731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c539da-b39e-46cf-b3ce-1b4aafa276bb service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:19.105808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1031/2043] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:47:27.407250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:29.101443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=31 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:29.998148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:30.000743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:30.015171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da8b60-1939-4df0-b5e6-81e758b5bdcd service glance] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:30.022325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fd006-ed20-4e89-916e-6fdd7b07ca22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:30.023063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fd006-ed20-4e89-916e-6fdd7b07ca22 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:30.023336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fd006-ed20-4e89-916e-6fdd7b07ca22 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:30.023601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fd006-ed20-4e89-916e-6fdd7b07ca22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:30.025530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d43fd006-ed20-4e89-916e-6fdd7b07ca22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:30.036611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fd006-ed20-4e89-916e-6fdd7b07ca22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:30.038176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fd006-ed20-4e89-916e-6fdd7b07ca22 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:30.047346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1013/2044] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:47:30.364766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c539da-b39e-46cf-b3ce-1b4aafa276bb service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:30.376462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c539da-b39e-46cf-b3ce-1b4aafa276bb service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:30.384590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:30.385458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:30.385838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:30.386209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:30.388660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:30.450168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:30.451814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:30.461098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1032/2045] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:47:32.578165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f9d10-d63c-4fdf-85dc-dbad790054fa None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:32.578684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f9d10-d63c-4fdf-85dc-dbad790054fa None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:32.578684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f9d10-d63c-4fdf-85dc-dbad790054fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:32.599865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-cb6f9d10-d63c-4fdf-85dc-dbad790054fa None None] MFA Rules not processed for user `79a2780405ee4b77a63166819c3da789`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:47:32.601170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cb6f9d10-d63c-4fdf-85dc-dbad790054fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:32.609171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1014/2046] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:47:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:47:33.169845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:33.171343 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:33.183898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3878cd-0d69-49e7-ae9c-ee2f2ea1300e service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:33.188203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dd9b5-e35d-458f-ab83-d68d16ebc048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:33.189077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dd9b5-e35d-458f-ab83-d68d16ebc048 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:33.189754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dd9b5-e35d-458f-ab83-d68d16ebc048 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:33.190092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dd9b5-e35d-458f-ab83-d68d16ebc048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:33.192459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fd5dd9b5-e35d-458f-ab83-d68d16ebc048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:33.202461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dd9b5-e35d-458f-ab83-d68d16ebc048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:33.203940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dd9b5-e35d-458f-ab83-d68d16ebc048 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:33.213099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1033/2047] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:47:33.548702 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f9d10-d63c-4fdf-85dc-dbad790054fa None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:33.550089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cb6f9d10-d63c-4fdf-85dc-dbad790054fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:33.635021 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f9d10-d63c-4fdf-85dc-dbad790054fa None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:33.642372 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf432a40-a598-41d6-80fa-14b5e021d504 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:33.643261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432a40-a598-41d6-80fa-14b5e021d504 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:33.643701 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432a40-a598-41d6-80fa-14b5e021d504 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:33.644109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432a40-a598-41d6-80fa-14b5e021d504 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:33.646183 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bf432a40-a598-41d6-80fa-14b5e021d504 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:33.659558 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf432a40-a598-41d6-80fa-14b5e021d504 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:33.662281 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf432a40-a598-41d6-80fa-14b5e021d504 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:33.680479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1015/2048] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:47:39.548749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dd9b5-e35d-458f-ab83-d68d16ebc048 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:39.561352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dd9b5-e35d-458f-ab83-d68d16ebc048 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:39.567385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bce0f-d822-4549-9a9a-1ddc810248b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:39.567989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bce0f-d822-4549-9a9a-1ddc810248b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:39.568261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bce0f-d822-4549-9a9a-1ddc810248b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:39.568526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bce0f-d822-4549-9a9a-1ddc810248b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:39.570435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-211bce0f-d822-4549-9a9a-1ddc810248b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:39.581305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bce0f-d822-4549-9a9a-1ddc810248b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:39.582890 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bce0f-d822-4549-9a9a-1ddc810248b8 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:39.591415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1034/2049] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:47:43.654691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84355fd0-8a0d-496d-85f8-f282a0ae2fd9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:43.655193 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84355fd0-8a0d-496d-85f8-f282a0ae2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:43.655309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84355fd0-8a0d-496d-85f8-f282a0ae2fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:43.675482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-84355fd0-8a0d-496d-85f8-f282a0ae2fd9 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:47:43.676675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-84355fd0-8a0d-496d-85f8-f282a0ae2fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:43.685122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1016/2050] 10.222.0.46 () {58 vars in 967 bytes} [Mon Oct 24 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:47:43.739722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bce0f-d822-4549-9a9a-1ddc810248b8 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:43.752798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bce0f-d822-4549-9a9a-1ddc810248b8 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:43.758957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2d84c-00b6-4441-b82c-a665ce5efb8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:43.759537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2d84c-00b6-4441-b82c-a665ce5efb8f service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:43.759853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2d84c-00b6-4441-b82c-a665ce5efb8f service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:43.760121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2d84c-00b6-4441-b82c-a665ce5efb8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:43.769163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2d84c-00b6-4441-b82c-a665ce5efb8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:43.770775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2d84c-00b6-4441-b82c-a665ce5efb8f service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:43.778960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1035/2051] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:47:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:47:47.632995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972f0a-8225-48f5-a478-588dae4de65e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:47.634076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972f0a-8225-48f5-a478-588dae4de65e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:47.634491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972f0a-8225-48f5-a478-588dae4de65e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:47.636115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1017/2052] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:47:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:47:47.651617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d6283-e723-4d54-a4ab-7267013de413 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:47.652744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d6283-e723-4d54-a4ab-7267013de413 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:47.653224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d6283-e723-4d54-a4ab-7267013de413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:47.679511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1a0d6283-e723-4d54-a4ab-7267013de413 None None] MFA Rules not processed for user `0f040c31c0d4439594404739d44a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:47:47.681174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1a0d6283-e723-4d54-a4ab-7267013de413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:47.691354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1036/2053] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:47:47.955904 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972f0a-8225-48f5-a478-588dae4de65e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:47.958211 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5c972f0a-8225-48f5-a478-588dae4de65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:47.984361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972f0a-8225-48f5-a478-588dae4de65e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:47.989419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6efb91-cd6f-4623-8783-13b7efb2ff90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:47.990032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6efb91-cd6f-4623-8783-13b7efb2ff90 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:47.990302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6efb91-cd6f-4623-8783-13b7efb2ff90 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:47.990566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6efb91-cd6f-4623-8783-13b7efb2ff90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:47.999771 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6efb91-cd6f-4623-8783-13b7efb2ff90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:48.001370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6efb91-cd6f-4623-8783-13b7efb2ff90 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:48.012005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1018/2054] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:47:51.385985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d6283-e723-4d54-a4ab-7267013de413 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:51.387578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1a0d6283-e723-4d54-a4ab-7267013de413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:51.457594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d6283-e723-4d54-a4ab-7267013de413 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:51.462636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:51.463314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:51.463590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:51.463867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] PATH_INFO: `/v3/users/3851579d7f034722a0b0975fd38e049d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:51.465088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3851579d7f034722a0b0975fd38e049d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:51.467080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:51.514859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3851579d7f034722a0b0975fd38e049d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.515539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3851579d7f034722a0b0975fd38e049d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.520934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:51.523176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3851579d7f034722a0b0975fd38e049d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.537920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3851579d7f034722a0b0975fd38e049d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.538740 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3851579d7f034722a0b0975fd38e049d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.553982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1037/2055] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:47:51 2022] DELETE /identity/v3/users/3851579d7f034722a0b0975fd38e049d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:47:51.736322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6efb91-cd6f-4623-8783-13b7efb2ff90 service placement] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:51.747728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6efb91-cd6f-4623-8783-13b7efb2ff90 service placement] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:51.808679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:51.809316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:51.809596 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:51.809865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] PATH_INFO: `/v3/projects/49c8f1acba25407a98ec267a83de763c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:51.811041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c8f1acba25407a98ec267a83de763c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:51.812947 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:51.864894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c8f1acba25407a98ec267a83de763c', 'request_id': 'req-aeed88ba-efcf-4111-ad80-9d4b64bdc754'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.866755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:51.871390 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c8f1acba25407a98ec267a83de763c', 'request_id': 'req-aeed88ba-efcf-4111-ad80-9d4b64bdc754'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.878079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c8f1acba25407a98ec267a83de763c', 'request_id': 'req-aeed88ba-efcf-4111-ad80-9d4b64bdc754'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.892740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] The token cache is being invalidate because project 49c8f1acba25407a98ec267a83de763c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:47:51.893022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.893692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:51.895229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1019/2056] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:47:51 2022] DELETE /identity/v3/projects/49c8f1acba25407a98ec267a83de763c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:47:51.899364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:51.900952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:51.915836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0922463-d73c-4074-89b0-9950dcb17930 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:51.978681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:51.979450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:51.979660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:51.979929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] PATH_INFO: `/v3/users/52269b63e07d457294a3d5d7b52b22f1` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:51.981175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52269b63e07d457294a3d5d7b52b22f1)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:51.983144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:52.035583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52269b63e07d457294a3d5d7b52b22f1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.036301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52269b63e07d457294a3d5d7b52b22f1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.043632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52269b63e07d457294a3d5d7b52b22f1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.055674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52269b63e07d457294a3d5d7b52b22f1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.056308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52269b63e07d457294a3d5d7b52b22f1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.070955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1038/2057] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:47:51 2022] DELETE /identity/v3/users/52269b63e07d457294a3d5d7b52b22f1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:47:52.250835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:52.252420 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:52.268992 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed88ba-efcf-4111-ad80-9d4b64bdc754 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:52.328745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:52.329380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:52.329651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:52.329917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] PATH_INFO: `/v3/projects/cfc31c9773fb4945b36256bf67993d6a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:52.331126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc31c9773fb4945b36256bf67993d6a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:52.333031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:52.381329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc31c9773fb4945b36256bf67993d6a', 'request_id': 'req-da160fcf-f336-4740-9fb6-900e155351f3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.388805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc31c9773fb4945b36256bf67993d6a', 'request_id': 'req-da160fcf-f336-4740-9fb6-900e155351f3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.394954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc31c9773fb4945b36256bf67993d6a', 'request_id': 'req-da160fcf-f336-4740-9fb6-900e155351f3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.409997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] The token cache is being invalidate because project cfc31c9773fb4945b36256bf67993d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:47:52.410397 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.411102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:47:52.412823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1020/2058] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:47:52 2022] DELETE /identity/v3/projects/cfc31c9773fb4945b36256bf67993d6a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:47:52.932717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:52.935299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:53.014441 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951c778-1798-40e8-b5a0-7ee26814e776 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:53.018421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:53.065218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:53.065985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:53.066350 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:53.066729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:53.069398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:53.138086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:53.139586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:53.149120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1039/2059] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:47:59.595760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:47:59.598008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:59.707814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da160fcf-f336-4740-9fb6-900e155351f3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:47:59.716383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:47:59.717125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:47:59.717462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:47:59.717796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:47:59.719995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:47:59.731856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:59.736150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:47:59.737663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:47:59.756984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1021/2060] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:47:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:03.144692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=45 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:09.766453 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:12.193499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:12.195231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:12.255517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c30c25-0a68-4fcf-bd3b-541abf0abd97 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:12.259893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:12.260474 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:12.260743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:12.261007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:12.262885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:12.330166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:12.331656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:12.342003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1040/2061] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:13.595415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:13.596841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:13.614160 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88b73-4602-42fa-bdb3-99fce194a1d1 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:13.619382 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578bb94-30e6-4b51-8a2f-52681fbd4ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:13.620454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578bb94-30e6-4b51-8a2f-52681fbd4ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:13.620643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578bb94-30e6-4b51-8a2f-52681fbd4ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:13.621175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578bb94-30e6-4b51-8a2f-52681fbd4ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:13.624005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1578bb94-30e6-4b51-8a2f-52681fbd4ad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:13.689629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578bb94-30e6-4b51-8a2f-52681fbd4ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:13.691166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578bb94-30e6-4b51-8a2f-52681fbd4ad9 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:13.702359 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1022/2062] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:15.676248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:15.677742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:15.696107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3864d9-28d4-4fd8-b81b-ac614f12e97e service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:15.701526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:15.702213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:15.702492 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:15.702764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] PATH_INFO: `/v3/users/59706abd14944c648378688abaac199d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:15.704077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59706abd14944c648378688abaac199d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:15.706012 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:15.757165 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59706abd14944c648378688abaac199d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:15.757940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59706abd14944c648378688abaac199d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:15.766327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59706abd14944c648378688abaac199d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:15.782609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59706abd14944c648378688abaac199d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:15.783362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ea9f92c-0234-4f85-a794-77a47208aa06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59706abd14944c648378688abaac199d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:15.798203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1041/2063] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:48:15 2022] DELETE /identity/v3/users/59706abd14944c648378688abaac199d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:15.975012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578bb94-30e6-4b51-8a2f-52681fbd4ad9 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:15.986319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578bb94-30e6-4b51-8a2f-52681fbd4ad9 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:16.049150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:16.049775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.050044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.050309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] PATH_INFO: `/v3/projects/bc17b178deb64cee8c33060fe19608eb` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.051451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc17b178deb64cee8c33060fe19608eb)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:16.053339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:16.111758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc17b178deb64cee8c33060fe19608eb', 'request_id': 'req-75bcfc7a-b857-40cd-bc16-41152240d24e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:16.118327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc17b178deb64cee8c33060fe19608eb', 'request_id': 'req-75bcfc7a-b857-40cd-bc16-41152240d24e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:16.124459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc17b178deb64cee8c33060fe19608eb', 'request_id': 'req-75bcfc7a-b857-40cd-bc16-41152240d24e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:16.141057 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] The token cache is being invalidate because project bc17b178deb64cee8c33060fe19608eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:48:16.141349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:16.141964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75bcfc7a-b857-40cd-bc16-41152240d24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:16.143503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1023/2064] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:48:15 2022] DELETE /identity/v3/projects/bc17b178deb64cee8c33060fe19608eb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:16.148689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70c27-1e49-42a0-8a00-1396020349c2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.149052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70c27-1e49-42a0-8a00-1396020349c2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.149382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70c27-1e49-42a0-8a00-1396020349c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.169721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b1d70c27-1e49-42a0-8a00-1396020349c2 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:16.170945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b1d70c27-1e49-42a0-8a00-1396020349c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:16.188663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:16.233943 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1042/2065] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:16.242116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9beda-c717-41fc-8835-e14a29a6df58 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.242453 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9beda-c717-41fc-8835-e14a29a6df58 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.242770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9beda-c717-41fc-8835-e14a29a6df58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.264012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3ff9beda-c717-41fc-8835-e14a29a6df58 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:16.265298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3ff9beda-c717-41fc-8835-e14a29a6df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:16.273673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1024/2066] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:16.277934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d70c27-1e49-42a0-8a00-1396020349c2 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:16.288142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d70c27-1e49-42a0-8a00-1396020349c2 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:16.293376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797fa1d-9709-48fd-9d45-1afa641c1ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:16.293990 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797fa1d-9709-48fd-9d45-1afa641c1ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.294266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797fa1d-9709-48fd-9d45-1afa641c1ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.294917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797fa1d-9709-48fd-9d45-1afa641c1ed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.295242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797fa1d-9709-48fd-9d45-1afa641c1ed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:48:16.295542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797fa1d-9709-48fd-9d45-1afa641c1ed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:16.297168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797fa1d-9709-48fd-9d45-1afa641c1ed7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:16.308964 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1043/2067] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:48:16.313624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9beda-c717-41fc-8835-e14a29a6df58 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:16.323152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9beda-c717-41fc-8835-e14a29a6df58 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:16.328126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf979b9-be93-4b34-ad26-c7ffd95591a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:16.328758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf979b9-be93-4b34-ad26-c7ffd95591a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.329059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf979b9-be93-4b34-ad26-c7ffd95591a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.329328 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf979b9-be93-4b34-ad26-c7ffd95591a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.329964 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf979b9-be93-4b34-ad26-c7ffd95591a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:16.331974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf979b9-be93-4b34-ad26-c7ffd95591a9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:16.359832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:16.367465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1025/2068] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:48:16 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:16.371783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797fa1d-9709-48fd-9d45-1afa641c1ed7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:16.382591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797fa1d-9709-48fd-9d45-1afa641c1ed7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:16.440676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19cf08-f58b-41d5-a9ad-e81112b87e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:16.441289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19cf08-f58b-41d5-a9ad-e81112b87e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.441563 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19cf08-f58b-41d5-a9ad-e81112b87e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.441864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19cf08-f58b-41d5-a9ad-e81112b87e85 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.442484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19cf08-f58b-41d5-a9ad-e81112b87e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:16.444457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19cf08-f58b-41d5-a9ad-e81112b87e85 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:16.468630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1044/2069] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:48:16 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:48:16.472749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf979b9-be93-4b34-ad26-c7ffd95591a9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:16.483687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf979b9-be93-4b34-ad26-c7ffd95591a9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:16.488758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb7b62-8913-4240-aad5-b719ac219b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:16.489355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb7b62-8913-4240-aad5-b719ac219b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.489649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb7b62-8913-4240-aad5-b719ac219b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.489911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb7b62-8913-4240-aad5-b719ac219b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.490550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb7b62-8913-4240-aad5-b719ac219b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:16.492174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb7b62-8913-4240-aad5-b719ac219b1f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:16.502376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1026/2070] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:16.506476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19cf08-f58b-41d5-a9ad-e81112b87e85 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:16.517829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19cf08-f58b-41d5-a9ad-e81112b87e85 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:16.525372 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f99c6d-2602-4ccb-8102-e1e6e44ab71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:16.525983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99c6d-2602-4ccb-8102-e1e6e44ab71a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.526525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99c6d-2602-4ccb-8102-e1e6e44ab71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.526525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99c6d-2602-4ccb-8102-e1e6e44ab71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.527290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f99c6d-2602-4ccb-8102-e1e6e44ab71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:16.528909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f99c6d-2602-4ccb-8102-e1e6e44ab71a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:16.540773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1045/2071] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:16.544874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb7b62-8913-4240-aad5-b719ac219b1f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:16.556393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb7b62-8913-4240-aad5-b719ac219b1f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:16.562359 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5601d-fb39-4ff9-996c-fc1edce142bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:16.563524 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5601d-fb39-4ff9-996c-fc1edce142bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.563797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5601d-fb39-4ff9-996c-fc1edce142bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.564065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5601d-fb39-4ff9-996c-fc1edce142bd admin admin] PATH_INFO: `/v3/projects/90fe9be9198740b49fab8a3a07141075/users/e8ce60ec1fe44a299575f3a2c04eef6d/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.580896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5601d-fb39-4ff9-996c-fc1edce142bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fe9be9198740b49fab8a3a07141075, user_id=e8ce60ec1fe44a299575f3a2c04eef6d, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:16.583671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5601d-fb39-4ff9-996c-fc1edce142bd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:16.600719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1027/2072] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:16 2022] PUT /identity/v3/projects/90fe9be9198740b49fab8a3a07141075/users/e8ce60ec1fe44a299575f3a2c04eef6d/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:16.611910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d7830-af64-4466-bc2b-9d948c7944d0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.612275 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d7830-af64-4466-bc2b-9d948c7944d0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.612613 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d7830-af64-4466-bc2b-9d948c7944d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.643945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f01d7830-af64-4466-bc2b-9d948c7944d0 None None] MFA Rules not processed for user `e8ce60ec1fe44a299575f3a2c04eef6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:16.647039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f01d7830-af64-4466-bc2b-9d948c7944d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:16.735809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1046/2073] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:16.747625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5601d-fb39-4ff9-996c-fc1edce142bd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:16.749418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c7c5601d-fb39-4ff9-996c-fc1edce142bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:16.827774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5601d-fb39-4ff9-996c-fc1edce142bd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:16.831944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297fb9-7752-4ab6-a235-16a77fafa728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:16.832643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297fb9-7752-4ab6-a235-16a77fafa728 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:16.832973 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297fb9-7752-4ab6-a235-16a77fafa728 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:16.833243 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297fb9-7752-4ab6-a235-16a77fafa728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:16.844185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f297fb9-7752-4ab6-a235-16a77fafa728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:16.845812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f297fb9-7752-4ab6-a235-16a77fafa728 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:16.857590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1028/2074] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:19.886976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9710c-56cc-4ac5-86c5-1b53f00e788d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:19.887513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9710c-56cc-4ac5-86c5-1b53f00e788d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:19.887513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9710c-56cc-4ac5-86c5-1b53f00e788d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:19.907310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-05b9710c-56cc-4ac5-86c5-1b53f00e788d None None] MFA Rules not processed for user `447498c7fe844b5d8cc616d71c3ff7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:19.908503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-05b9710c-56cc-4ac5-86c5-1b53f00e788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:19.920211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:19.964365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1047/2075] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:48:20.315397 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297fb9-7752-4ab6-a235-16a77fafa728 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:20.317611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3f297fb9-7752-4ab6-a235-16a77fafa728 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:20.379294 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297fb9-7752-4ab6-a235-16a77fafa728 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:20.383826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb44062-b1e5-4701-bbe5-7fca17e9b090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:20.384435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44062-b1e5-4701-bbe5-7fca17e9b090 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:20.384831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44062-b1e5-4701-bbe5-7fca17e9b090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:20.385100 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44062-b1e5-4701-bbe5-7fca17e9b090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:20.387126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fdb44062-b1e5-4701-bbe5-7fca17e9b090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:20.397874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb44062-b1e5-4701-bbe5-7fca17e9b090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:20.399398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb44062-b1e5-4701-bbe5-7fca17e9b090 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:20.407963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1029/2076] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:25.493779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9710c-56cc-4ac5-86c5-1b53f00e788d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:25.560182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9710c-56cc-4ac5-86c5-1b53f00e788d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:25.565856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:25.566599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:25.566995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:25.567354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] PATH_INFO: `/v3/users/e8ce60ec1fe44a299575f3a2c04eef6d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:25.568851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ce60ec1fe44a299575f3a2c04eef6d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:25.571022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:25.623630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ce60ec1fe44a299575f3a2c04eef6d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:25.624275 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ce60ec1fe44a299575f3a2c04eef6d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:25.631659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ce60ec1fe44a299575f3a2c04eef6d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:25.645996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ce60ec1fe44a299575f3a2c04eef6d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:25.646762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ce60ec1fe44a299575f3a2c04eef6d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:25.663074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1048/2077] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:48:25 2022] DELETE /identity/v3/users/e8ce60ec1fe44a299575f3a2c04eef6d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:25.667794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca9dc0-53d8-4eb6-98bf-cd2a6a001c53 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:25.668288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca9dc0-53d8-4eb6-98bf-cd2a6a001c53 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:25.668288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca9dc0-53d8-4eb6-98bf-cd2a6a001c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:25.688482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-23ca9dc0-53d8-4eb6-98bf-cd2a6a001c53 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:25.689674 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-23ca9dc0-53d8-4eb6-98bf-cd2a6a001c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:25.748804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1030/2078] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:25.759406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:25.761887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:25.814719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:25.828850 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d5a7b-8e1d-48ec-a735-4a0e3db96405 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:25.832769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca07f2-d51c-4fdf-85a0-07e076bc2e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:25.833369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca07f2-d51c-4fdf-85a0-07e076bc2e02 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:25.833674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca07f2-d51c-4fdf-85a0-07e076bc2e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:25.833915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca07f2-d51c-4fdf-85a0-07e076bc2e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:25.843484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca07f2-d51c-4fdf-85a0-07e076bc2e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:25.844907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca07f2-d51c-4fdf-85a0-07e076bc2e02 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:25.854754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1049/2079] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:26.140533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca9dc0-53d8-4eb6-98bf-cd2a6a001c53 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:26.142487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-23ca9dc0-53d8-4eb6-98bf-cd2a6a001c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:26.157224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca9dc0-53d8-4eb6-98bf-cd2a6a001c53 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:26.162891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:26.163651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.163995 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.164329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] PATH_INFO: `/v3/projects/90fe9be9198740b49fab8a3a07141075` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.165631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fe9be9198740b49fab8a3a07141075)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:26.168278 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:26.175342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:26.222355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fe9be9198740b49fab8a3a07141075', 'request_id': 'req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:26.228799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fe9be9198740b49fab8a3a07141075', 'request_id': 'req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:26.234716 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fe9be9198740b49fab8a3a07141075', 'request_id': 'req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:26.249971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] The token cache is being invalidate because project 90fe9be9198740b49fab8a3a07141075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:48:26.250277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:26.250978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc3fdf9c-fabf-47b4-b59e-b52e5391cc58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:26.252579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1031/2080] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:48:26 2022] DELETE /identity/v3/projects/90fe9be9198740b49fab8a3a07141075 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:26.258155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eb8a9-bd49-4a89-b55b-35a6d167b79a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.258447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eb8a9-bd49-4a89-b55b-35a6d167b79a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.258784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eb8a9-bd49-4a89-b55b-35a6d167b79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.279308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f44eb8a9-bd49-4a89-b55b-35a6d167b79a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:26.280473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f44eb8a9-bd49-4a89-b55b-35a6d167b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:26.342443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1050/2081] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:26.351535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629915ea-b31d-47fa-8a94-679a0cbaaa1d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.352432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629915ea-b31d-47fa-8a94-679a0cbaaa1d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.353771 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629915ea-b31d-47fa-8a94-679a0cbaaa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.380254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-629915ea-b31d-47fa-8a94-679a0cbaaa1d None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:26.382173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-629915ea-b31d-47fa-8a94-679a0cbaaa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:26.401490 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1032/2082] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:26.402865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44eb8a9-bd49-4a89-b55b-35a6d167b79a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:26.413373 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44eb8a9-bd49-4a89-b55b-35a6d167b79a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:26.418796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c35cc8-c4a2-46a6-88cb-a373d51f88a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:26.420031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c35cc8-c4a2-46a6-88cb-a373d51f88a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.420517 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c35cc8-c4a2-46a6-88cb-a373d51f88a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.420995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c35cc8-c4a2-46a6-88cb-a373d51f88a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.422381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c35cc8-c4a2-46a6-88cb-a373d51f88a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:48:26.423129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c35cc8-c4a2-46a6-88cb-a373d51f88a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:26.425141 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c35cc8-c4a2-46a6-88cb-a373d51f88a1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:26.439739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1051/2083] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:48:26.444063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629915ea-b31d-47fa-8a94-679a0cbaaa1d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:26.457385 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629915ea-b31d-47fa-8a94-679a0cbaaa1d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:26.462984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a872f5-46cd-40cd-9422-1848fe7a43b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:26.463796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a872f5-46cd-40cd-9422-1848fe7a43b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.464242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a872f5-46cd-40cd-9422-1848fe7a43b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.464508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a872f5-46cd-40cd-9422-1848fe7a43b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.465140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a872f5-46cd-40cd-9422-1848fe7a43b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:26.467280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a872f5-46cd-40cd-9422-1848fe7a43b0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:26.502460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1033/2084] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:48:26 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:26.507094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c35cc8-c4a2-46a6-88cb-a373d51f88a1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:26.520777 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c35cc8-c4a2-46a6-88cb-a373d51f88a1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:26.591404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f909c-6b3b-461e-8b96-804bb8d6150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:26.592344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f909c-6b3b-461e-8b96-804bb8d6150e admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.592867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f909c-6b3b-461e-8b96-804bb8d6150e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.593281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f909c-6b3b-461e-8b96-804bb8d6150e admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.594062 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f909c-6b3b-461e-8b96-804bb8d6150e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:26.596071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f909c-6b3b-461e-8b96-804bb8d6150e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:26.621433 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1052/2085] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:48:26 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:48:26.625306 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a872f5-46cd-40cd-9422-1848fe7a43b0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:26.636601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a872f5-46cd-40cd-9422-1848fe7a43b0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:26.641779 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f181f-90a1-40ef-89b6-960f97aee2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:26.642610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f181f-90a1-40ef-89b6-960f97aee2ed admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.642957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f181f-90a1-40ef-89b6-960f97aee2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.643332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f181f-90a1-40ef-89b6-960f97aee2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.644585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f181f-90a1-40ef-89b6-960f97aee2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:26.645569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f181f-90a1-40ef-89b6-960f97aee2ed admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:26.659017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1034/2086] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:48:26.662332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f909c-6b3b-461e-8b96-804bb8d6150e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:26.675212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f909c-6b3b-461e-8b96-804bb8d6150e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:26.682872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d113746-c015-4ee4-bbec-253d3f329e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:26.682872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d113746-c015-4ee4-bbec-253d3f329e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.682872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d113746-c015-4ee4-bbec-253d3f329e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.682872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d113746-c015-4ee4-bbec-253d3f329e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.683260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d113746-c015-4ee4-bbec-253d3f329e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:26.683447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d113746-c015-4ee4-bbec-253d3f329e75 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:26.694883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1053/2087] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:26.699163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f181f-90a1-40ef-89b6-960f97aee2ed admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:26.709953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f181f-90a1-40ef-89b6-960f97aee2ed admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:26.714735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb6ae-64af-4b57-b866-45f8eb6746da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:26.715410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb6ae-64af-4b57-b866-45f8eb6746da admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.715677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb6ae-64af-4b57-b866-45f8eb6746da admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.715944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb6ae-64af-4b57-b866-45f8eb6746da admin admin] PATH_INFO: `/v3/projects/d4ab1e3268844366a648b1d3330dc5d3/users/9e5990c147ad4e59b89180c94bc8301d/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.731556 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cb6ae-64af-4b57-b866-45f8eb6746da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ab1e3268844366a648b1d3330dc5d3, user_id=9e5990c147ad4e59b89180c94bc8301d, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:26.734175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cb6ae-64af-4b57-b866-45f8eb6746da admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:26.749234 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1035/2088] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:26 2022] PUT /identity/v3/projects/d4ab1e3268844366a648b1d3330dc5d3/users/9e5990c147ad4e59b89180c94bc8301d/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:26.760736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403952d7-3e54-4607-9d20-c45c5edd4f4f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.761103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403952d7-3e54-4607-9d20-c45c5edd4f4f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.761437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403952d7-3e54-4607-9d20-c45c5edd4f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.794567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-403952d7-3e54-4607-9d20-c45c5edd4f4f None None] MFA Rules not processed for user `9e5990c147ad4e59b89180c94bc8301d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:26.795821 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-403952d7-3e54-4607-9d20-c45c5edd4f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:26.836884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:26.861743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1054/2089] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:26.866332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb6ae-64af-4b57-b866-45f8eb6746da admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:26.931033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb6ae-64af-4b57-b866-45f8eb6746da admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:26.936413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e430-8459-4764-847e-eddd8698add1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:26.937013 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e430-8459-4764-847e-eddd8698add1 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:26.937289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e430-8459-4764-847e-eddd8698add1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:26.937559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e430-8459-4764-847e-eddd8698add1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:26.938188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4e430-8459-4764-847e-eddd8698add1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:26.940125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4e430-8459-4764-847e-eddd8698add1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:26.970166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1036/2090] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:48:26 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:26.974378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403952d7-3e54-4607-9d20-c45c5edd4f4f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:26.985665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403952d7-3e54-4607-9d20-c45c5edd4f4f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:27.044861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe304-5649-4b89-a587-aefe12807719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:27.045391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe304-5649-4b89-a587-aefe12807719 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:27.045678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe304-5649-4b89-a587-aefe12807719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:27.045952 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe304-5649-4b89-a587-aefe12807719 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:27.046601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fe304-5649-4b89-a587-aefe12807719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:27.048571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fe304-5649-4b89-a587-aefe12807719 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:27.071794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1055/2091] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:48:26 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:48:27.075979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e430-8459-4764-847e-eddd8698add1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:27.086548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e430-8459-4764-847e-eddd8698add1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:27.091075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74fd35-4667-4c2b-86a1-431951b10eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:27.091672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74fd35-4667-4c2b-86a1-431951b10eca admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:27.091924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74fd35-4667-4c2b-86a1-431951b10eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:27.092190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74fd35-4667-4c2b-86a1-431951b10eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:27.092833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74fd35-4667-4c2b-86a1-431951b10eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:27.094428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74fd35-4667-4c2b-86a1-431951b10eca admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:27.105862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1037/2092] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:27.110515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe304-5649-4b89-a587-aefe12807719 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:27.120918 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe304-5649-4b89-a587-aefe12807719 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:27.126166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfc8b4-9b51-4a63-9dec-001ad5a05723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:27.126804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfc8b4-9b51-4a63-9dec-001ad5a05723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:27.127117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfc8b4-9b51-4a63-9dec-001ad5a05723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:27.127412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfc8b4-9b51-4a63-9dec-001ad5a05723 admin admin] PATH_INFO: `/v3/projects/486f954e59f649e8b8b4711bdb54f4e4/users/74ce70a20f154a51908a16cbf1bf88cf/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:27.146297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfc8b4-9b51-4a63-9dec-001ad5a05723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486f954e59f649e8b8b4711bdb54f4e4, user_id=74ce70a20f154a51908a16cbf1bf88cf, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:27.149013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfc8b4-9b51-4a63-9dec-001ad5a05723 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:27.164806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1056/2093] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:27 2022] PUT /identity/v3/projects/486f954e59f649e8b8b4711bdb54f4e4/users/74ce70a20f154a51908a16cbf1bf88cf/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:27.169150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74fd35-4667-4c2b-86a1-431951b10eca admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:27.175612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:27.179420 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74fd35-4667-4c2b-86a1-431951b10eca admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:27.241893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f10f7-c68a-403d-a79c-cccd391ab817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:27.242855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f10f7-c68a-403d-a79c-cccd391ab817 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:27.243347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f10f7-c68a-403d-a79c-cccd391ab817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:27.243812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f10f7-c68a-403d-a79c-cccd391ab817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:27.244947 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f10f7-c68a-403d-a79c-cccd391ab817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:27.248053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f10f7-c68a-403d-a79c-cccd391ab817 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:27.264096 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1038/2094] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:27.268638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfc8b4-9b51-4a63-9dec-001ad5a05723 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:27.279982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfc8b4-9b51-4a63-9dec-001ad5a05723 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:27.285326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6252a50-bf47-44e8-9415-74047adad731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:27.285978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6252a50-bf47-44e8-9415-74047adad731 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:27.286256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6252a50-bf47-44e8-9415-74047adad731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:27.286526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6252a50-bf47-44e8-9415-74047adad731 admin admin] PATH_INFO: `/v3/projects/486f954e59f649e8b8b4711bdb54f4e4/users/74ce70a20f154a51908a16cbf1bf88cf/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:27.288578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6252a50-bf47-44e8-9415-74047adad731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486f954e59f649e8b8b4711bdb54f4e4, user_id=74ce70a20f154a51908a16cbf1bf88cf, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:27.291263 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6252a50-bf47-44e8-9415-74047adad731 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:27.302029 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1057/2095] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:27 2022] PUT /identity/v3/projects/486f954e59f649e8b8b4711bdb54f4e4/users/74ce70a20f154a51908a16cbf1bf88cf/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:27.313832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa4d77-1cf0-4fbf-8ed2-4c6d49d52956 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:27.314113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa4d77-1cf0-4fbf-8ed2-4c6d49d52956 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:27.314387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa4d77-1cf0-4fbf-8ed2-4c6d49d52956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:27.343718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-40aa4d77-1cf0-4fbf-8ed2-4c6d49d52956 None None] MFA Rules not processed for user `74ce70a20f154a51908a16cbf1bf88cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:27.344937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-40aa4d77-1cf0-4fbf-8ed2-4c6d49d52956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:27.433754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1039/2096] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:27.445460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6252a50-bf47-44e8-9415-74047adad731 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:27.447480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c6252a50-bf47-44e8-9415-74047adad731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:27.507087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6252a50-bf47-44e8-9415-74047adad731 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:27.511628 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b951-0f49-48b2-a92b-775be60ffe81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:27.512242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b951-0f49-48b2-a92b-775be60ffe81 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:27.512510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b951-0f49-48b2-a92b-775be60ffe81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:27.512759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b951-0f49-48b2-a92b-775be60ffe81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:27.523299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6b951-0f49-48b2-a92b-775be60ffe81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:27.524758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6b951-0f49-48b2-a92b-775be60ffe81 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:27.535143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1058/2097] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:27.952957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa4d77-1cf0-4fbf-8ed2-4c6d49d52956 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:28.022420 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa4d77-1cf0-4fbf-8ed2-4c6d49d52956 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:28.027429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:28.028127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:28.028414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:28.028687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] PATH_INFO: `/v3/users/9e5990c147ad4e59b89180c94bc8301d` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:28.029799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5990c147ad4e59b89180c94bc8301d)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:28.032425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:28.066017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:28.085594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5990c147ad4e59b89180c94bc8301d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.086177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5990c147ad4e59b89180c94bc8301d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.093857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5990c147ad4e59b89180c94bc8301d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.105615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5990c147ad4e59b89180c94bc8301d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.106304 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5990c147ad4e59b89180c94bc8301d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.119481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1040/2098] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:48:27 2022] DELETE /identity/v3/users/9e5990c147ad4e59b89180c94bc8301d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:28.124296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263df96-8fa1-4f2e-a60e-972c326d5201 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:28.124677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263df96-8fa1-4f2e-a60e-972c326d5201 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:28.125021 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263df96-8fa1-4f2e-a60e-972c326d5201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:28.144610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e263df96-8fa1-4f2e-a60e-972c326d5201 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:28.145852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e263df96-8fa1-4f2e-a60e-972c326d5201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:28.175929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:28.207504 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1059/2099] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:28.217468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:28.218996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:28.278960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa8092-7e7b-4616-8999-96f8dffc7210 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:28.283265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae23a3-57f6-4ff4-b6e6-aa74ab436299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:28.283874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae23a3-57f6-4ff4-b6e6-aa74ab436299 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:28.284152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae23a3-57f6-4ff4-b6e6-aa74ab436299 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:28.284425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae23a3-57f6-4ff4-b6e6-aa74ab436299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:28.294380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae23a3-57f6-4ff4-b6e6-aa74ab436299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:28.295870 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae23a3-57f6-4ff4-b6e6-aa74ab436299 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:28.305583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1041/2100] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:28.585094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263df96-8fa1-4f2e-a60e-972c326d5201 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:28.586578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e263df96-8fa1-4f2e-a60e-972c326d5201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:28.600222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263df96-8fa1-4f2e-a60e-972c326d5201 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:28.605137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:28.606292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:28.606577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:28.606844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] PATH_INFO: `/v3/projects/d4ab1e3268844366a648b1d3330dc5d3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:28.608153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ab1e3268844366a648b1d3330dc5d3)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:28.610071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:28.663596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ab1e3268844366a648b1d3330dc5d3', 'request_id': 'req-822258a0-0267-43b1-8fa4-d06c204a3d82'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.670090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ab1e3268844366a648b1d3330dc5d3', 'request_id': 'req-822258a0-0267-43b1-8fa4-d06c204a3d82'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.676416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ab1e3268844366a648b1d3330dc5d3', 'request_id': 'req-822258a0-0267-43b1-8fa4-d06c204a3d82'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.690346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] The token cache is being invalidate because project d4ab1e3268844366a648b1d3330dc5d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:48:28.690626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.691236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.692732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1060/2101] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:48:28 2022] DELETE /identity/v3/projects/d4ab1e3268844366a648b1d3330dc5d3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:28.696774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae23a3-57f6-4ff4-b6e6-aa74ab436299 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:28.706740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae23a3-57f6-4ff4-b6e6-aa74ab436299 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:28.767259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:28.768012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:28.768386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:28.768658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] PATH_INFO: `/v3/users/74ce70a20f154a51908a16cbf1bf88cf` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:28.769803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ce70a20f154a51908a16cbf1bf88cf)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:28.771783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:28.821661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ce70a20f154a51908a16cbf1bf88cf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.822325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ce70a20f154a51908a16cbf1bf88cf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.824564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:28.830948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ce70a20f154a51908a16cbf1bf88cf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.843546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ce70a20f154a51908a16cbf1bf88cf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.844191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0e780b44-4d19-4640-8229-f54fae456769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ce70a20f154a51908a16cbf1bf88cf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:28.859018 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1042/2102] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:48:28 2022] DELETE /identity/v3/users/74ce70a20f154a51908a16cbf1bf88cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:29.168583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:29.170069 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:29.187773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822258a0-0267-43b1-8fa4-d06c204a3d82 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:29.262332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:29.263167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.263537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.263915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] PATH_INFO: `/v3/projects/486f954e59f649e8b8b4711bdb54f4e4` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.265715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=486f954e59f649e8b8b4711bdb54f4e4)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:29.268828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:29.330142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486f954e59f649e8b8b4711bdb54f4e4', 'request_id': 'req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:29.335814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486f954e59f649e8b8b4711bdb54f4e4', 'request_id': 'req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:29.337569 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:29.342073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486f954e59f649e8b8b4711bdb54f4e4', 'request_id': 'req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:29.357892 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] The token cache is being invalidate because project 486f954e59f649e8b8b4711bdb54f4e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:48:29.358160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:29.358754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a55f090f-00bc-41fa-b3e1-0dd8870e4cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:29.360284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1061/2103] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:48:29 2022] DELETE /identity/v3/projects/486f954e59f649e8b8b4711bdb54f4e4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:29.366187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddab1a9-494b-4b35-b4ee-d253e3e51406 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.366739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddab1a9-494b-4b35-b4ee-d253e3e51406 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.366739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddab1a9-494b-4b35-b4ee-d253e3e51406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.391888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6ddab1a9-494b-4b35-b4ee-d253e3e51406 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:29.393082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6ddab1a9-494b-4b35-b4ee-d253e3e51406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:29.456902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1043/2104] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:29.467436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b9ab1-ba73-4f96-b289-234a69ca7963 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.467718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b9ab1-ba73-4f96-b289-234a69ca7963 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.467963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b9ab1-ba73-4f96-b289-234a69ca7963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.489085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b26b9ab1-ba73-4f96-b289-234a69ca7963 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:29.490562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b26b9ab1-ba73-4f96-b289-234a69ca7963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:29.499257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1062/2105] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:29.503618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddab1a9-494b-4b35-b4ee-d253e3e51406 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:29.514081 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddab1a9-494b-4b35-b4ee-d253e3e51406 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:29.519742 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d85d2-411e-44c9-aa23-294accbe5b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:29.520610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d85d2-411e-44c9-aa23-294accbe5b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.520610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d85d2-411e-44c9-aa23-294accbe5b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.520830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d85d2-411e-44c9-aa23-294accbe5b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.521557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d85d2-411e-44c9-aa23-294accbe5b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:48:29.521911 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d85d2-411e-44c9-aa23-294accbe5b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:29.523679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d85d2-411e-44c9-aa23-294accbe5b4f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:29.538295 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1044/2106] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:48:29.543249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b9ab1-ba73-4f96-b289-234a69ca7963 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:29.552820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b9ab1-ba73-4f96-b289-234a69ca7963 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:29.558617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d4cff-6f96-42e5-8d26-12f8f446b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:29.559299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4cff-6f96-42e5-8d26-12f8f446b8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.559580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4cff-6f96-42e5-8d26-12f8f446b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.559818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4cff-6f96-42e5-8d26-12f8f446b8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.560445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d4cff-6f96-42e5-8d26-12f8f446b8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:29.562407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d4cff-6f96-42e5-8d26-12f8f446b8e4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:29.597124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1063/2107] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:48:29 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:29.601568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d85d2-411e-44c9-aa23-294accbe5b4f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:29.612497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d85d2-411e-44c9-aa23-294accbe5b4f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:29.645355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d4cff-6f96-42e5-8d26-12f8f446b8e4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:29.647380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ce7d4cff-6f96-42e5-8d26-12f8f446b8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:29.678963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584c5df-e952-49aa-8286-b07a5ea6f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:29.679581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584c5df-e952-49aa-8286-b07a5ea6f90a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.679855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584c5df-e952-49aa-8286-b07a5ea6f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.680130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584c5df-e952-49aa-8286-b07a5ea6f90a admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.680772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584c5df-e952-49aa-8286-b07a5ea6f90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:29.682710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584c5df-e952-49aa-8286-b07a5ea6f90a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:29.709376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1045/2108] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:48:29 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:29.713662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584c5df-e952-49aa-8286-b07a5ea6f90a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:29.723585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584c5df-e952-49aa-8286-b07a5ea6f90a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:29.728205 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b04ab-327d-46bd-b029-ece9ccd06e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:29.728789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b04ab-327d-46bd-b029-ece9ccd06e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.729057 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b04ab-327d-46bd-b029-ece9ccd06e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.729322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b04ab-327d-46bd-b029-ece9ccd06e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.729483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d4cff-6f96-42e5-8d26-12f8f446b8e4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:29.729986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b04ab-327d-46bd-b029-ece9ccd06e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:29.731635 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b04ab-327d-46bd-b029-ece9ccd06e93 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:29.735471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf063f4e-ae1b-458d-8d90-c463ac722c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:29.736194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063f4e-ae1b-458d-8d90-c463ac722c64 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.736467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063f4e-ae1b-458d-8d90-c463ac722c64 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.736732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063f4e-ae1b-458d-8d90-c463ac722c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.738461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bf063f4e-ae1b-458d-8d90-c463ac722c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:29.742275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1046/2109] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:29.746402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b04ab-327d-46bd-b029-ece9ccd06e93 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:29.751927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf063f4e-ae1b-458d-8d90-c463ac722c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:29.753781 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf063f4e-ae1b-458d-8d90-c463ac722c64 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:29.759197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b04ab-327d-46bd-b029-ece9ccd06e93 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:29.764384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c35729-be00-445e-91f6-df9a0bee893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:29.764987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c35729-be00-445e-91f6-df9a0bee893e admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.765258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c35729-be00-445e-91f6-df9a0bee893e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.765520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c35729-be00-445e-91f6-df9a0bee893e admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.765750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1064/2110] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:48:29.766154 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c35729-be00-445e-91f6-df9a0bee893e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:29.767763 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c35729-be00-445e-91f6-df9a0bee893e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:29.781147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1047/2111] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:48:29.782303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf063f4e-ae1b-458d-8d90-c463ac722c64 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:29.793336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf063f4e-ae1b-458d-8d90-c463ac722c64 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:29.799134 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3377c0-7a88-431f-b3eb-1cfbafe4915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:29.799937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3377c0-7a88-431f-b3eb-1cfbafe4915e admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.800215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3377c0-7a88-431f-b3eb-1cfbafe4915e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.800478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3377c0-7a88-431f-b3eb-1cfbafe4915e admin admin] PATH_INFO: `/v3/projects/855f64106772422f8d1e97ca77c585a4/users/ed6e64978e7846daa17d4239d9ccb0e4/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.817139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3377c0-7a88-431f-b3eb-1cfbafe4915e admin admin] RBAC: Authorizing `identity:create_grant(project_id=855f64106772422f8d1e97ca77c585a4, user_id=ed6e64978e7846daa17d4239d9ccb0e4, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:29.819807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3377c0-7a88-431f-b3eb-1cfbafe4915e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:29.836187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1065/2112] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:29 2022] PUT /identity/v3/projects/855f64106772422f8d1e97ca77c585a4/users/ed6e64978e7846daa17d4239d9ccb0e4/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:29.846700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc9eed-59df-437a-8a99-2262c37a88b1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:29.847069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc9eed-59df-437a-8a99-2262c37a88b1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:29.847492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc9eed-59df-437a-8a99-2262c37a88b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:29.877766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-83fc9eed-59df-437a-8a99-2262c37a88b1 None None] MFA Rules not processed for user `ed6e64978e7846daa17d4239d9ccb0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:29.879006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-83fc9eed-59df-437a-8a99-2262c37a88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:29.889856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:29.950197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1048/2113] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:48:29.954856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3377c0-7a88-431f-b3eb-1cfbafe4915e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:30.022630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3377c0-7a88-431f-b3eb-1cfbafe4915e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:30.027911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5e295-99dc-4d30-8b65-9893600e0c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:30.028590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5e295-99dc-4d30-8b65-9893600e0c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.028934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5e295-99dc-4d30-8b65-9893600e0c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.029202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5e295-99dc-4d30-8b65-9893600e0c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.029989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5e295-99dc-4d30-8b65-9893600e0c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:30.031955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5e295-99dc-4d30-8b65-9893600e0c35 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:30.060607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1066/2114] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:48:29 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:30.064830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc9eed-59df-437a-8a99-2262c37a88b1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:30.076391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc9eed-59df-437a-8a99-2262c37a88b1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:30.135037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42396c49-6d51-4ac1-9b65-6b30787b1600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:30.135640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42396c49-6d51-4ac1-9b65-6b30787b1600 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.136128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42396c49-6d51-4ac1-9b65-6b30787b1600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.136408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42396c49-6d51-4ac1-9b65-6b30787b1600 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.137032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42396c49-6d51-4ac1-9b65-6b30787b1600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:30.138915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42396c49-6d51-4ac1-9b65-6b30787b1600 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:30.163198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1049/2115] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:48:30 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:48:30.169768 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5e295-99dc-4d30-8b65-9893600e0c35 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:30.180544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5e295-99dc-4d30-8b65-9893600e0c35 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:30.186055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eec2d-71f0-4c25-b9b3-d19ce1e2c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:30.186656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eec2d-71f0-4c25-b9b3-d19ce1e2c457 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.186957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eec2d-71f0-4c25-b9b3-d19ce1e2c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.187226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eec2d-71f0-4c25-b9b3-d19ce1e2c457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.187867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eec2d-71f0-4c25-b9b3-d19ce1e2c457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:30.189498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eec2d-71f0-4c25-b9b3-d19ce1e2c457 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:30.191052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:30.205311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1067/2116] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:48:30.207207 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42396c49-6d51-4ac1-9b65-6b30787b1600 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:30.218310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42396c49-6d51-4ac1-9b65-6b30787b1600 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:30.222943 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e362f-106c-47d8-99e0-b358b4ba710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:30.223598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e362f-106c-47d8-99e0-b358b4ba710f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.223867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e362f-106c-47d8-99e0-b358b4ba710f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.224132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e362f-106c-47d8-99e0-b358b4ba710f admin admin] PATH_INFO: `/v3/projects/62dd654533d54c4295b9524ff3bb06c5/users/79c8e6558057438799ed6d33010b687c/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.239673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e362f-106c-47d8-99e0-b358b4ba710f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dd654533d54c4295b9524ff3bb06c5, user_id=79c8e6558057438799ed6d33010b687c, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:30.242331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e362f-106c-47d8-99e0-b358b4ba710f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:30.257447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1050/2117] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:30 2022] PUT /identity/v3/projects/62dd654533d54c4295b9524ff3bb06c5/users/79c8e6558057438799ed6d33010b687c/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:30.262040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eec2d-71f0-4c25-b9b3-d19ce1e2c457 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:30.272203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eec2d-71f0-4c25-b9b3-d19ce1e2c457 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:30.329352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44e46-827e-4fd4-80e6-fda99d4038ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:30.329968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44e46-827e-4fd4-80e6-fda99d4038ba admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.330246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44e46-827e-4fd4-80e6-fda99d4038ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.330516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44e46-827e-4fd4-80e6-fda99d4038ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.331191 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44e46-827e-4fd4-80e6-fda99d4038ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:30.332814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44e46-827e-4fd4-80e6-fda99d4038ba admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:30.343769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1068/2118] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:48:30.347489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e362f-106c-47d8-99e0-b358b4ba710f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:30.358307 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e362f-106c-47d8-99e0-b358b4ba710f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:30.363195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc634-9b14-4115-abce-582764f12bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:30.363877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc634-9b14-4115-abce-582764f12bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.364152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc634-9b14-4115-abce-582764f12bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.364423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc634-9b14-4115-abce-582764f12bdf admin admin] PATH_INFO: `/v3/projects/62dd654533d54c4295b9524ff3bb06c5/users/79c8e6558057438799ed6d33010b687c/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.366353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc634-9b14-4115-abce-582764f12bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dd654533d54c4295b9524ff3bb06c5, user_id=79c8e6558057438799ed6d33010b687c, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:30.369020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc634-9b14-4115-abce-582764f12bdf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:30.380562 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1051/2119] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:30 2022] PUT /identity/v3/projects/62dd654533d54c4295b9524ff3bb06c5/users/79c8e6558057438799ed6d33010b687c/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:30.392066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c148-959a-420a-a1cf-92fa625f22d8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.392353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c148-959a-420a-a1cf-92fa625f22d8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.392641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c148-959a-420a-a1cf-92fa625f22d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.420623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fd34c148-959a-420a-a1cf-92fa625f22d8 None None] MFA Rules not processed for user `79c8e6558057438799ed6d33010b687c`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:30.421969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fd34c148-959a-420a-a1cf-92fa625f22d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:30.492257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1069/2120] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:48:30.503910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc634-9b14-4115-abce-582764f12bdf admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:30.505840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-48ecc634-9b14-4115-abce-582764f12bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:30.577867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc634-9b14-4115-abce-582764f12bdf admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:30.581719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6bd96-d1ab-49cd-a578-5344fba32918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:30.582321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6bd96-d1ab-49cd-a578-5344fba32918 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.582592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6bd96-d1ab-49cd-a578-5344fba32918 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.582862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6bd96-d1ab-49cd-a578-5344fba32918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.592533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6bd96-d1ab-49cd-a578-5344fba32918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:30.593959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6bd96-d1ab-49cd-a578-5344fba32918 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:30.604036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1052/2121] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:30.673361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34c148-959a-420a-a1cf-92fa625f22d8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:30.742409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34c148-959a-420a-a1cf-92fa625f22d8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:30.747711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:30.748320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.748587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.748851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] PATH_INFO: `/v3/users/ed6e64978e7846daa17d4239d9ccb0e4` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.750010 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6e64978e7846daa17d4239d9ccb0e4)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:30.751972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:30.772824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:30.801486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6e64978e7846daa17d4239d9ccb0e4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:30.802155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6e64978e7846daa17d4239d9ccb0e4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:30.809157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6e64978e7846daa17d4239d9ccb0e4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:30.821303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6e64978e7846daa17d4239d9ccb0e4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:30.821961 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6e64978e7846daa17d4239d9ccb0e4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:30.838271 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1070/2122] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:48:30 2022] DELETE /identity/v3/users/ed6e64978e7846daa17d4239d9ccb0e4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:30.846270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6db07-a628-4858-b962-83ae5996082f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:30.846646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6db07-a628-4858-b962-83ae5996082f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:30.847066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6db07-a628-4858-b962-83ae5996082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:30.863559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:30.869897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-42c6db07-a628-4858-b962-83ae5996082f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:30.871926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-42c6db07-a628-4858-b962-83ae5996082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:30.931396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1053/2123] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:30.942537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:30.944105 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:31.007337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28105804-98c0-4334-9951-10fb88ff2137 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:31.011825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4622d7-ce06-491a-a553-a3745cc6e97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:31.012429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4622d7-ce06-491a-a553-a3745cc6e97e service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:31.012695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4622d7-ce06-491a-a553-a3745cc6e97e service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:31.012971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4622d7-ce06-491a-a553-a3745cc6e97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:31.022380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4622d7-ce06-491a-a553-a3745cc6e97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:31.023854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4622d7-ce06-491a-a553-a3745cc6e97e service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:31.034175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1071/2124] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:31.309228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6db07-a628-4858-b962-83ae5996082f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:31.310775 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-42c6db07-a628-4858-b962-83ae5996082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:31.323224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6db07-a628-4858-b962-83ae5996082f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:31.328498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:31.329174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:31.329512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:31.329789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] PATH_INFO: `/v3/projects/855f64106772422f8d1e97ca77c585a4` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:31.330908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855f64106772422f8d1e97ca77c585a4)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:31.332868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:31.390224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855f64106772422f8d1e97ca77c585a4', 'request_id': 'req-9b0dd933-7146-43ab-9e6e-366951fcedf1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.397329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855f64106772422f8d1e97ca77c585a4', 'request_id': 'req-9b0dd933-7146-43ab-9e6e-366951fcedf1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.403298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855f64106772422f8d1e97ca77c585a4', 'request_id': 'req-9b0dd933-7146-43ab-9e6e-366951fcedf1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.418298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] The token cache is being invalidate because project 855f64106772422f8d1e97ca77c585a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:48:31.418583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.419222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.420937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1054/2125] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:48:31 2022] DELETE /identity/v3/projects/855f64106772422f8d1e97ca77c585a4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:31.424812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4622d7-ce06-491a-a553-a3745cc6e97e service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:31.434909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4622d7-ce06-491a-a553-a3745cc6e97e service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:31.495955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:31.496514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:31.496786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:31.497057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] PATH_INFO: `/v3/users/79c8e6558057438799ed6d33010b687c` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:31.498147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c8e6558057438799ed6d33010b687c)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:31.500118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:31.544587 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:31.550280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c8e6558057438799ed6d33010b687c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.551063 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c8e6558057438799ed6d33010b687c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.558718 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c8e6558057438799ed6d33010b687c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.571058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c8e6558057438799ed6d33010b687c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.571729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-08f75ec1-45a2-4775-bdfb-6152f6874c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c8e6558057438799ed6d33010b687c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:31.589706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1072/2126] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:48:31 2022] DELETE /identity/v3/users/79c8e6558057438799ed6d33010b687c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:31.876123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:31.877918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:31.894898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dd933-7146-43ab-9e6e-366951fcedf1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:31.954476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:31.955122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:31.955394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:31.955664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] PATH_INFO: `/v3/projects/62dd654533d54c4295b9524ff3bb06c5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:31.956762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62dd654533d54c4295b9524ff3bb06c5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:31.958664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:31.994557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:32.007982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62dd654533d54c4295b9524ff3bb06c5', 'request_id': 'req-ce87310c-3615-465e-a8cc-cc16a8757b87'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:32.014132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62dd654533d54c4295b9524ff3bb06c5', 'request_id': 'req-ce87310c-3615-465e-a8cc-cc16a8757b87'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:32.019576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62dd654533d54c4295b9524ff3bb06c5', 'request_id': 'req-ce87310c-3615-465e-a8cc-cc16a8757b87'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:32.034213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] The token cache is being invalidate because project 62dd654533d54c4295b9524ff3bb06c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:48:32.034494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:32.035223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ce87310c-3615-465e-a8cc-cc16a8757b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:32.036848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1055/2127] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:48:31 2022] DELETE /identity/v3/projects/62dd654533d54c4295b9524ff3bb06c5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:48:32.041968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69727277-f817-4bbb-a8fd-3ccb8a196c90 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.042477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69727277-f817-4bbb-a8fd-3ccb8a196c90 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.042477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69727277-f817-4bbb-a8fd-3ccb8a196c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.062871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-69727277-f817-4bbb-a8fd-3ccb8a196c90 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:32.064176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-69727277-f817-4bbb-a8fd-3ccb8a196c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:32.134550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1073/2128] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:32.142671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b208c-e9f8-4054-ab63-5d258997b04f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.142953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b208c-e9f8-4054-ab63-5d258997b04f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.143252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b208c-e9f8-4054-ab63-5d258997b04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.164303 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f82b208c-e9f8-4054-ab63-5d258997b04f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:32.165511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f82b208c-e9f8-4054-ab63-5d258997b04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:32.175343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1056/2129] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:32.179731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69727277-f817-4bbb-a8fd-3ccb8a196c90 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.190153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69727277-f817-4bbb-a8fd-3ccb8a196c90 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.195525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b00ab6-c446-4380-982d-7b27f63a7b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.196146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b00ab6-c446-4380-982d-7b27f63a7b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.196423 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b00ab6-c446-4380-982d-7b27f63a7b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.196685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b00ab6-c446-4380-982d-7b27f63a7b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.197316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b00ab6-c446-4380-982d-7b27f63a7b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:48:32.197607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b00ab6-c446-4380-982d-7b27f63a7b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.199482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b00ab6-c446-4380-982d-7b27f63a7b4d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.210915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1074/2130] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:48:32.215287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b208c-e9f8-4054-ab63-5d258997b04f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.224727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b208c-e9f8-4054-ab63-5d258997b04f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.230008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384be5c-b094-44eb-bac4-6d1d11953b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.230599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384be5c-b094-44eb-bac4-6d1d11953b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.230881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384be5c-b094-44eb-bac4-6d1d11953b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.231173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384be5c-b094-44eb-bac4-6d1d11953b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.231811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384be5c-b094-44eb-bac4-6d1d11953b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.233747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384be5c-b094-44eb-bac4-6d1d11953b46 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.266272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1057/2131] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:48:32 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:32.271250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b00ab6-c446-4380-982d-7b27f63a7b4d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.286516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b00ab6-c446-4380-982d-7b27f63a7b4d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.355995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e3e29-7f07-4bfe-bff3-b803b9f9eafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.356601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e3e29-7f07-4bfe-bff3-b803b9f9eafb admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.356872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e3e29-7f07-4bfe-bff3-b803b9f9eafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.357192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e3e29-7f07-4bfe-bff3-b803b9f9eafb admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.357832 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e3e29-7f07-4bfe-bff3-b803b9f9eafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.359793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e3e29-7f07-4bfe-bff3-b803b9f9eafb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.384634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1075/2132] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:48:32 2022] POST /identity/v3/users => generated 305 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:32.389407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384be5c-b094-44eb-bac4-6d1d11953b46 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.401177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384be5c-b094-44eb-bac4-6d1d11953b46 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.406950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfab537-6099-4de1-bdd1-47db8c7d15aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.407557 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfab537-6099-4de1-bdd1-47db8c7d15aa admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.407834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfab537-6099-4de1-bdd1-47db8c7d15aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.408098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfab537-6099-4de1-bdd1-47db8c7d15aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.408745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfab537-6099-4de1-bdd1-47db8c7d15aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.410348 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfab537-6099-4de1-bdd1-47db8c7d15aa admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.421064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1058/2133] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:32.425135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e3e29-7f07-4bfe-bff3-b803b9f9eafb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.435979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e3e29-7f07-4bfe-bff3-b803b9f9eafb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.441025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9bdd-99c3-45c1-b535-2b918415a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.441603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9bdd-99c3-45c1-b535-2b918415a113 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.441875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9bdd-99c3-45c1-b535-2b918415a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.442137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9bdd-99c3-45c1-b535-2b918415a113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.442773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf9bdd-99c3-45c1-b535-2b918415a113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.444425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf9bdd-99c3-45c1-b535-2b918415a113 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.455338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1076/2134] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:32.459548 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfab537-6099-4de1-bdd1-47db8c7d15aa admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.470389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfab537-6099-4de1-bdd1-47db8c7d15aa admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.476661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30013068-bdee-49e6-8b8a-30a067b2fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.477344 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30013068-bdee-49e6-8b8a-30a067b2fc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.477617 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30013068-bdee-49e6-8b8a-30a067b2fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.477884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30013068-bdee-49e6-8b8a-30a067b2fc1e admin admin] PATH_INFO: `/v3/projects/90a6cc7c628a49438b9f1a3d9621384c/users/9ab6d638e0344c0eabe2cc1f2d657a0d/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.495632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30013068-bdee-49e6-8b8a-30a067b2fc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a6cc7c628a49438b9f1a3d9621384c, user_id=9ab6d638e0344c0eabe2cc1f2d657a0d, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.498908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30013068-bdee-49e6-8b8a-30a067b2fc1e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.515640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1059/2135] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:32 2022] PUT /identity/v3/projects/90a6cc7c628a49438b9f1a3d9621384c/users/9ab6d638e0344c0eabe2cc1f2d657a0d/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:32.526421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf530e-aeb5-48e2-81c7-98764f58b563 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.526688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf530e-aeb5-48e2-81c7-98764f58b563 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.526994 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf530e-aeb5-48e2-81c7-98764f58b563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.556759 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-26bf530e-aeb5-48e2-81c7-98764f58b563 None None] MFA Rules not processed for user `9ab6d638e0344c0eabe2cc1f2d657a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:32.558142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-26bf530e-aeb5-48e2-81c7-98764f58b563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:32.570553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:32.629791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1077/2136] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:32.634253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30013068-bdee-49e6-8b8a-30a067b2fc1e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.697741 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30013068-bdee-49e6-8b8a-30a067b2fc1e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.702552 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236e23-7163-49d4-b2f1-37aaefb2b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.703195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236e23-7163-49d4-b2f1-37aaefb2b3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.703469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236e23-7163-49d4-b2f1-37aaefb2b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.703736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236e23-7163-49d4-b2f1-37aaefb2b3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.704381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236e23-7163-49d4-b2f1-37aaefb2b3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.706291 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236e23-7163-49d4-b2f1-37aaefb2b3f1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.735496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1060/2137] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:48:32 2022] POST /identity/v3/projects => generated 407 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:32.738959 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf530e-aeb5-48e2-81c7-98764f58b563 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.751118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf530e-aeb5-48e2-81c7-98764f58b563 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.807691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28506b4b-d956-4129-9d66-3cd61252186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.808310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28506b4b-d956-4129-9d66-3cd61252186b admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.808599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28506b4b-d956-4129-9d66-3cd61252186b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.808870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28506b4b-d956-4129-9d66-3cd61252186b admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.809765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28506b4b-d956-4129-9d66-3cd61252186b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.811790 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28506b4b-d956-4129-9d66-3cd61252186b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.838381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1078/2138] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:48:32 2022] POST /identity/v3/users => generated 310 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:32.839977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236e23-7163-49d4-b2f1-37aaefb2b3f1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.850583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236e23-7163-49d4-b2f1-37aaefb2b3f1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.856049 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a62c97-732c-4607-bbc9-3b0137f37924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.856750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62c97-732c-4607-bbc9-3b0137f37924 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.857090 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62c97-732c-4607-bbc9-3b0137f37924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.857443 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62c97-732c-4607-bbc9-3b0137f37924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.858095 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a62c97-732c-4607-bbc9-3b0137f37924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.859756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a62c97-732c-4607-bbc9-3b0137f37924 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.875852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1061/2139] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:32.877018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28506b4b-d956-4129-9d66-3cd61252186b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.887562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28506b4b-d956-4129-9d66-3cd61252186b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.892379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130b8ef-6708-4f73-b408-cc41179f0594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:32.893036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130b8ef-6708-4f73-b408-cc41179f0594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:32.893306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130b8ef-6708-4f73-b408-cc41179f0594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:32.893564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130b8ef-6708-4f73-b408-cc41179f0594 admin admin] PATH_INFO: `/v3/projects/081b2484155143cfb9fca5ed61150212/users/82e7e2f12e284357b6f7d342896ae4a7/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:32.908795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130b8ef-6708-4f73-b408-cc41179f0594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081b2484155143cfb9fca5ed61150212, user_id=82e7e2f12e284357b6f7d342896ae4a7, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:32.911486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130b8ef-6708-4f73-b408-cc41179f0594 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:32.926099 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1079/2140] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:32 2022] PUT /identity/v3/projects/081b2484155143cfb9fca5ed61150212/users/82e7e2f12e284357b6f7d342896ae4a7/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:32.930260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a62c97-732c-4607-bbc9-3b0137f37924 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:32.940903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a62c97-732c-4607-bbc9-3b0137f37924 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:32.972158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:33.004571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e7d5a-aeb8-4b43-a8a7-c1be3e3e58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:33.005123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e7d5a-aeb8-4b43-a8a7-c1be3e3e58b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:33.005396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e7d5a-aeb8-4b43-a8a7-c1be3e3e58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:33.005660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e7d5a-aeb8-4b43-a8a7-c1be3e3e58b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:33.006769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e7d5a-aeb8-4b43-a8a7-c1be3e3e58b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:33.008464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e7d5a-aeb8-4b43-a8a7-c1be3e3e58b8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:33.019383 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1062/2141] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:48:33.023720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130b8ef-6708-4f73-b408-cc41179f0594 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:33.034563 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130b8ef-6708-4f73-b408-cc41179f0594 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:33.039592 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac253e3-6d0c-40dd-9892-20993adfdbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:33.040249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac253e3-6d0c-40dd-9892-20993adfdbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:33.040524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac253e3-6d0c-40dd-9892-20993adfdbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:33.040795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac253e3-6d0c-40dd-9892-20993adfdbeb admin admin] PATH_INFO: `/v3/projects/081b2484155143cfb9fca5ed61150212/users/82e7e2f12e284357b6f7d342896ae4a7/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:33.042685 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac253e3-6d0c-40dd-9892-20993adfdbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=081b2484155143cfb9fca5ed61150212, user_id=82e7e2f12e284357b6f7d342896ae4a7, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:33.045610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac253e3-6d0c-40dd-9892-20993adfdbeb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:33.056507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1080/2142] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:33 2022] PUT /identity/v3/projects/081b2484155143cfb9fca5ed61150212/users/82e7e2f12e284357b6f7d342896ae4a7/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:33.068488 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2c9e-5e8f-46d3-8940-cd3a99c57f1e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:33.068804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2c9e-5e8f-46d3-8940-cd3a99c57f1e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:33.069045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2c9e-5e8f-46d3-8940-cd3a99c57f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:33.099635 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-65eb2c9e-5e8f-46d3-8940-cd3a99c57f1e None None] MFA Rules not processed for user `82e7e2f12e284357b6f7d342896ae4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:33.100909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-65eb2c9e-5e8f-46d3-8940-cd3a99c57f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:33.173150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1063/2143] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:33.184444 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac253e3-6d0c-40dd-9892-20993adfdbeb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:33.186574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9ac253e3-6d0c-40dd-9892-20993adfdbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:33.247656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac253e3-6d0c-40dd-9892-20993adfdbeb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:33.252087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6c557-4632-439f-8e3d-a58bd338287f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:33.252701 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6c557-4632-439f-8e3d-a58bd338287f service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:33.252973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6c557-4632-439f-8e3d-a58bd338287f service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:33.253241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6c557-4632-439f-8e3d-a58bd338287f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:33.264101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6c557-4632-439f-8e3d-a58bd338287f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:33.265479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6c557-4632-439f-8e3d-a58bd338287f service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:33.275465 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1081/2144] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:33.447888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb2c9e-5e8f-46d3-8940-cd3a99c57f1e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:33.458109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb2c9e-5e8f-46d3-8940-cd3a99c57f1e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:33.461878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828b2f2-100c-4cfb-878a-a7af374aa35d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:33.462483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b2f2-100c-4cfb-878a-a7af374aa35d service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:33.462781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b2f2-100c-4cfb-878a-a7af374aa35d service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:33.463086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b2f2-100c-4cfb-878a-a7af374aa35d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:33.523267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828b2f2-100c-4cfb-878a-a7af374aa35d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:33.524615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828b2f2-100c-4cfb-878a-a7af374aa35d service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:33.533727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1064/2145] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:38.978682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6c557-4632-439f-8e3d-a58bd338287f service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:38.989556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:39.044182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6c557-4632-439f-8e3d-a58bd338287f service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:39.049025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:39.049643 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:39.049911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:39.050172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] PATH_INFO: `/v3/users/9ab6d638e0344c0eabe2cc1f2d657a0d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:39.051752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab6d638e0344c0eabe2cc1f2d657a0d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:39.053670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:39.103732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab6d638e0344c0eabe2cc1f2d657a0d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.104360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab6d638e0344c0eabe2cc1f2d657a0d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.111512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab6d638e0344c0eabe2cc1f2d657a0d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.124286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab6d638e0344c0eabe2cc1f2d657a0d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.125106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab6d638e0344c0eabe2cc1f2d657a0d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.141238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1082/2146] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:48:38 2022] DELETE /identity/v3/users/9ab6d638e0344c0eabe2cc1f2d657a0d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:48:39.147688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd59393-78e4-4217-afa2-e95cb1b80316 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:39.148180 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd59393-78e4-4217-afa2-e95cb1b80316 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:39.148298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd59393-78e4-4217-afa2-e95cb1b80316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:39.172468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1bd59393-78e4-4217-afa2-e95cb1b80316 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:39.173671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1bd59393-78e4-4217-afa2-e95cb1b80316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:39.223445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:39.245826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1065/2147] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:39.256680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:39.258117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:39.318766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5dd76-3687-4187-b426-4a9a98a403a0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:39.322858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3c282-25a0-4f66-8e1c-0266f629da31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:39.323467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3c282-25a0-4f66-8e1c-0266f629da31 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:39.323732 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3c282-25a0-4f66-8e1c-0266f629da31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:39.324000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3c282-25a0-4f66-8e1c-0266f629da31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:39.333612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3c282-25a0-4f66-8e1c-0266f629da31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:39.335089 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3c282-25a0-4f66-8e1c-0266f629da31 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:39.345683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1083/2148] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:39.617656 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd59393-78e4-4217-afa2-e95cb1b80316 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:39.619264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1bd59393-78e4-4217-afa2-e95cb1b80316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:39.632979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd59393-78e4-4217-afa2-e95cb1b80316 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:39.644201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:39.644950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:39.645191 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:39.645482 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] PATH_INFO: `/v3/projects/90a6cc7c628a49438b9f1a3d9621384c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:39.646787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a6cc7c628a49438b9f1a3d9621384c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:39.648771 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:39.698042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a6cc7c628a49438b9f1a3d9621384c', 'request_id': 'req-aeebbb51-1846-4f18-bef3-22468a215cc4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.704429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a6cc7c628a49438b9f1a3d9621384c', 'request_id': 'req-aeebbb51-1846-4f18-bef3-22468a215cc4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.710517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a6cc7c628a49438b9f1a3d9621384c', 'request_id': 'req-aeebbb51-1846-4f18-bef3-22468a215cc4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.725030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] The token cache is being invalidate because project 90a6cc7c628a49438b9f1a3d9621384c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:48:39.725312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.725953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.727530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1066/2149] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:48:39 2022] DELETE /identity/v3/projects/90a6cc7c628a49438b9f1a3d9621384c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:39.731708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3c282-25a0-4f66-8e1c-0266f629da31 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:39.741561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3c282-25a0-4f66-8e1c-0266f629da31 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:39.773176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:39.804235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:39.804864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:39.805133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:39.805400 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] PATH_INFO: `/v3/users/82e7e2f12e284357b6f7d342896ae4a7` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:39.806550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e7e2f12e284357b6f7d342896ae4a7)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:39.808534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:39.860473 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e7e2f12e284357b6f7d342896ae4a7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.861117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e7e2f12e284357b6f7d342896ae4a7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.868342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e7e2f12e284357b6f7d342896ae4a7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.881867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e7e2f12e284357b6f7d342896ae4a7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.882550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c4d13b60-4984-4e28-853a-cac9f78e951a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e7e2f12e284357b6f7d342896ae4a7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:39.897974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1084/2150] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:48:39 2022] DELETE /identity/v3/users/82e7e2f12e284357b6f7d342896ae4a7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:48:40.190856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:40.192425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:40.208252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebbb51-1846-4f18-bef3-22468a215cc4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:40.267157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:40.267718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.267991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.268260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] PATH_INFO: `/v3/projects/081b2484155143cfb9fca5ed61150212` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.269487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=081b2484155143cfb9fca5ed61150212)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:40.271442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:40.326593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081b2484155143cfb9fca5ed61150212', 'request_id': 'req-14a0407e-fffb-4901-a40a-3b110e55e802'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:40.333970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081b2484155143cfb9fca5ed61150212', 'request_id': 'req-14a0407e-fffb-4901-a40a-3b110e55e802'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:40.340483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081b2484155143cfb9fca5ed61150212', 'request_id': 'req-14a0407e-fffb-4901-a40a-3b110e55e802'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:40.353826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] The token cache is being invalidate because project 081b2484155143cfb9fca5ed61150212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:48:40.354114 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:40.354717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-14a0407e-fffb-4901-a40a-3b110e55e802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:48:40.356230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1067/2151] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:48:40 2022] DELETE /identity/v3/projects/081b2484155143cfb9fca5ed61150212 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:40.362494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683656-5ddf-4f0f-8ced-c0ed721131f5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.362989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683656-5ddf-4f0f-8ced-c0ed721131f5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.363096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683656-5ddf-4f0f-8ced-c0ed721131f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.386042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3f683656-5ddf-4f0f-8ced-c0ed721131f5 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:40.387344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3f683656-5ddf-4f0f-8ced-c0ed721131f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:40.447865 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1085/2152] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:40.456446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608824-18d0-43dd-b7ce-23e3e20ceea4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.456722 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608824-18d0-43dd-b7ce-23e3e20ceea4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.456986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608824-18d0-43dd-b7ce-23e3e20ceea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.465933 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:40.478569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-dd608824-18d0-43dd-b7ce-23e3e20ceea4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:40.480525 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dd608824-18d0-43dd-b7ce-23e3e20ceea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:40.489338 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1068/2153] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:40.493716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f683656-5ddf-4f0f-8ced-c0ed721131f5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:40.504233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f683656-5ddf-4f0f-8ced-c0ed721131f5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:40.509936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294efdc-a809-4782-adbc-daf3183822a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:40.510526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294efdc-a809-4782-adbc-daf3183822a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.510801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294efdc-a809-4782-adbc-daf3183822a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.511100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294efdc-a809-4782-adbc-daf3183822a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.511741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294efdc-a809-4782-adbc-daf3183822a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:48:40.512019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294efdc-a809-4782-adbc-daf3183822a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:40.513625 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294efdc-a809-4782-adbc-daf3183822a4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:40.525416 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1086/2154] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:48:40.529690 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608824-18d0-43dd-b7ce-23e3e20ceea4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:40.539014 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608824-18d0-43dd-b7ce-23e3e20ceea4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:40.544078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47be20-84e3-4bb6-9b4b-431c7b9a7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:40.544660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47be20-84e3-4bb6-9b4b-431c7b9a7838 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.544924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47be20-84e3-4bb6-9b4b-431c7b9a7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.545176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47be20-84e3-4bb6-9b4b-431c7b9a7838 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.545807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47be20-84e3-4bb6-9b4b-431c7b9a7838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:40.547760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47be20-84e3-4bb6-9b4b-431c7b9a7838 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:40.577709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1069/2155] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:48:40 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:48:40.582609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294efdc-a809-4782-adbc-daf3183822a4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:40.596801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294efdc-a809-4782-adbc-daf3183822a4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:40.638958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:40.662945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769bd77-677f-4324-b179-20608da93bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:40.663545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769bd77-677f-4324-b179-20608da93bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.663795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769bd77-677f-4324-b179-20608da93bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.664084 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769bd77-677f-4324-b179-20608da93bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.664689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769bd77-677f-4324-b179-20608da93bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:40.666641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769bd77-677f-4324-b179-20608da93bd9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:40.690107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1087/2156] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:48:40 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:48:40.695004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47be20-84e3-4bb6-9b4b-431c7b9a7838 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:40.710254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47be20-84e3-4bb6-9b4b-431c7b9a7838 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:40.717826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76076e62-bb76-471d-a782-34f9a67ca150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:40.718588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76076e62-bb76-471d-a782-34f9a67ca150 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.718861 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76076e62-bb76-471d-a782-34f9a67ca150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.719483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76076e62-bb76-471d-a782-34f9a67ca150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.720601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76076e62-bb76-471d-a782-34f9a67ca150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:40.722267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76076e62-bb76-471d-a782-34f9a67ca150 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:40.732969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1070/2157] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:40.737210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769bd77-677f-4324-b179-20608da93bd9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:40.747424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769bd77-677f-4324-b179-20608da93bd9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:40.752164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f8cf3-5e6f-494b-9686-de96cf965906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:40.752746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8cf3-5e6f-494b-9686-de96cf965906 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.753020 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8cf3-5e6f-494b-9686-de96cf965906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.753283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8cf3-5e6f-494b-9686-de96cf965906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.753910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f8cf3-5e6f-494b-9686-de96cf965906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:40.755555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f8cf3-5e6f-494b-9686-de96cf965906 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:40.766429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1088/2158] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:48:40.771041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76076e62-bb76-471d-a782-34f9a67ca150 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:40.781032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76076e62-bb76-471d-a782-34f9a67ca150 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:40.785994 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03113314-5af3-4118-9e77-a1b663e527c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:40.786635 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03113314-5af3-4118-9e77-a1b663e527c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.786910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03113314-5af3-4118-9e77-a1b663e527c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.787217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03113314-5af3-4118-9e77-a1b663e527c6 admin admin] PATH_INFO: `/v3/projects/ba1214fa8009443e95e105138be0738c/users/7cfdf248e9be4ac985d7a4b48b940a81/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.802192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03113314-5af3-4118-9e77-a1b663e527c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1214fa8009443e95e105138be0738c, user_id=7cfdf248e9be4ac985d7a4b48b940a81, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:40.804870 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03113314-5af3-4118-9e77-a1b663e527c6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:40.820769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1071/2159] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:48:40 2022] PUT /identity/v3/projects/ba1214fa8009443e95e105138be0738c/users/7cfdf248e9be4ac985d7a4b48b940a81/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:48:40.826115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81a9eb-43db-4665-bf55-5dcd61b64029 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.826486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81a9eb-43db-4665-bf55-5dcd61b64029 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.826816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81a9eb-43db-4665-bf55-5dcd61b64029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.846624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bc81a9eb-43db-4665-bf55-5dcd61b64029 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:40.847842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bc81a9eb-43db-4665-bf55-5dcd61b64029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:40.911739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1089/2160] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:40.921653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03113314-5af3-4118-9e77-a1b663e527c6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:40.924079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-03113314-5af3-4118-9e77-a1b663e527c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:40.984948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03113314-5af3-4118-9e77-a1b663e527c6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:40.988769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e42a5-e0e9-4eac-836a-fdc4f745b833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:40.989376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e42a5-e0e9-4eac-836a-fdc4f745b833 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:40.989648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e42a5-e0e9-4eac-836a-fdc4f745b833 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:40.989914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e42a5-e0e9-4eac-836a-fdc4f745b833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:40.998862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e42a5-e0e9-4eac-836a-fdc4f745b833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:41.000472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e42a5-e0e9-4eac-836a-fdc4f745b833 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:41.010228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1072/2161] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:48:41.663139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aea9d-40fa-4764-ba8e-36e7711f8448 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:41.663642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aea9d-40fa-4764-ba8e-36e7711f8448 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:41.663913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aea9d-40fa-4764-ba8e-36e7711f8448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:41.693526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-059aea9d-40fa-4764-ba8e-36e7711f8448 None None] MFA Rules not processed for user `7cfdf248e9be4ac985d7a4b48b940a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:41.694756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-059aea9d-40fa-4764-ba8e-36e7711f8448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:41.761399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1090/2162] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:41.772535 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e42a5-e0e9-4eac-836a-fdc4f745b833 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:48:41.773997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-491e42a5-e0e9-4eac-836a-fdc4f745b833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:41.832091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e42a5-e0e9-4eac-836a-fdc4f745b833 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:48:41.835587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73943686-3d4b-4452-a1f2-02d56b840cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:48:41.836227 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73943686-3d4b-4452-a1f2-02d56b840cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:41.836499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73943686-3d4b-4452-a1f2-02d56b840cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:41.836771 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73943686-3d4b-4452-a1f2-02d56b840cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:41.845430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73943686-3d4b-4452-a1f2-02d56b840cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:48:41.846863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73943686-3d4b-4452-a1f2-02d56b840cc2 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:48:41.855632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1073/2163] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:48:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:48:43.243042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44f978-8963-4a42-83c7-2d03998887d5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:48:43.243580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44f978-8963-4a42-83c7-2d03998887d5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:48:43.243580 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44f978-8963-4a42-83c7-2d03998887d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:48:43.262688 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3d44f978-8963-4a42-83c7-2d03998887d5 None None] MFA Rules not processed for user `7cfdf248e9be4ac985d7a4b48b940a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:48:43.263912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3d44f978-8963-4a42-83c7-2d03998887d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:48:43.270808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1091/2164] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:48:51.851624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:53.257479 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:00.459836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dbd57-f362-443e-9fec-d85742b6a09a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:00.460720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dbd57-f362-443e-9fec-d85742b6a09a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:00.460915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dbd57-f362-443e-9fec-d85742b6a09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:00.483384 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ba0dbd57-f362-443e-9fec-d85742b6a09a None None] MFA Rules not processed for user `6414c4b3a3ca4d4bab67712790abff00`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:00.484650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ba0dbd57-f362-443e-9fec-d85742b6a09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:00.549559 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1074/2165] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:49:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:49:10.542132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=25 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:14.455545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44f978-8963-4a42-83c7-2d03998887d5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:14.457180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3d44f978-8963-4a42-83c7-2d03998887d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:14.533415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44f978-8963-4a42-83c7-2d03998887d5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:14.538794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d151-4ce8-4910-a07d-b8f60d21b859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:14.539367 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d151-4ce8-4910-a07d-b8f60d21b859 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:14.539639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d151-4ce8-4910-a07d-b8f60d21b859 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:14.539899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d151-4ce8-4910-a07d-b8f60d21b859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:14.541647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3551d151-4ce8-4910-a07d-b8f60d21b859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:14.553722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551d151-4ce8-4910-a07d-b8f60d21b859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:14.555352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551d151-4ce8-4910-a07d-b8f60d21b859 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:14.567042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1092/2166] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:49:16.336758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74d76e-8e40-4e7a-bb94-3d9aebdff336 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:16.337554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74d76e-8e40-4e7a-bb94-3d9aebdff336 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:16.337554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74d76e-8e40-4e7a-bb94-3d9aebdff336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:16.365624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7e74d76e-8e40-4e7a-bb94-3d9aebdff336 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:16.366826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7e74d76e-8e40-4e7a-bb94-3d9aebdff336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:16.376073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1075/2167] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:16.392784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d151-4ce8-4910-a07d-b8f60d21b859 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:16.406092 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d151-4ce8-4910-a07d-b8f60d21b859 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:16.413702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd2420-de06-4045-a8c5-ebb70310a647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:16.414298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd2420-de06-4045-a8c5-ebb70310a647 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:16.414566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd2420-de06-4045-a8c5-ebb70310a647 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:16.414834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd2420-de06-4045-a8c5-ebb70310a647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:16.423644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd2420-de06-4045-a8c5-ebb70310a647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:16.425229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd2420-de06-4045-a8c5-ebb70310a647 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:16.435198 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1093/2168] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:49:20.409345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105337a-befd-4b32-9de1-83d13fdee599 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:20.409917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105337a-befd-4b32-9de1-83d13fdee599 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:20.409917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105337a-befd-4b32-9de1-83d13fdee599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:20.431687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b105337a-befd-4b32-9de1-83d13fdee599 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:20.432900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b105337a-befd-4b32-9de1-83d13fdee599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:20.441817 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1076/2169] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:49:20.456999 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd2420-de06-4045-a8c5-ebb70310a647 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:20.458437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-67bd2420-de06-4045-a8c5-ebb70310a647 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:20.473412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd2420-de06-4045-a8c5-ebb70310a647 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:20.479430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d540b-2a1b-4874-803a-115e271ad5f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:20.480033 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d540b-2a1b-4874-803a-115e271ad5f0 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:20.480313 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d540b-2a1b-4874-803a-115e271ad5f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:20.480579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d540b-2a1b-4874-803a-115e271ad5f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:20.490044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d540b-2a1b-4874-803a-115e271ad5f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:20.491724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d540b-2a1b-4874-803a-115e271ad5f0 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:20.502242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1094/2170] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:49:23.678066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a1515-5b78-4045-9860-2558941f9291 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:23.678587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a1515-5b78-4045-9860-2558941f9291 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:23.678587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a1515-5b78-4045-9860-2558941f9291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:23.699821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c26a1515-5b78-4045-9860-2558941f9291 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:23.701020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c26a1515-5b78-4045-9860-2558941f9291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:23.710579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1077/2171] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:49:23.725058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d540b-2a1b-4874-803a-115e271ad5f0 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:23.737393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d540b-2a1b-4874-803a-115e271ad5f0 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:23.744891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e92cc4-6575-411e-8f2a-08f1df223d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:23.745495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e92cc4-6575-411e-8f2a-08f1df223d15 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:23.745764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e92cc4-6575-411e-8f2a-08f1df223d15 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:23.746028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e92cc4-6575-411e-8f2a-08f1df223d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:23.758754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e92cc4-6575-411e-8f2a-08f1df223d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:23.760380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e92cc4-6575-411e-8f2a-08f1df223d15 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:23.770634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1095/2172] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:49:26.776491 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccbece-56b7-4cfa-9983-c7310a9c0651 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:26.777008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccbece-56b7-4cfa-9983-c7310a9c0651 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:26.777008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccbece-56b7-4cfa-9983-c7310a9c0651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:26.798704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e2ccbece-56b7-4cfa-9983-c7310a9c0651 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:26.800263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e2ccbece-56b7-4cfa-9983-c7310a9c0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:26.809049 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1078/2173] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:26.825448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e92cc4-6575-411e-8f2a-08f1df223d15 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:26.836729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e92cc4-6575-411e-8f2a-08f1df223d15 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:26.842085 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009e50b-c7bd-4ca7-8ce0-9df0cf18a7a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:26.842672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009e50b-c7bd-4ca7-8ce0-9df0cf18a7a7 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:26.842969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009e50b-c7bd-4ca7-8ce0-9df0cf18a7a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:26.843242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009e50b-c7bd-4ca7-8ce0-9df0cf18a7a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:26.851526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009e50b-c7bd-4ca7-8ce0-9df0cf18a7a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:26.853118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009e50b-c7bd-4ca7-8ce0-9df0cf18a7a7 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:26.862228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1096/2174] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:49:31.047888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf735-f386-458e-b674-687994de4ee2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:31.048449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf735-f386-458e-b674-687994de4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:31.048449 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf735-f386-458e-b674-687994de4ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:31.070399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-534bf735-f386-458e-b674-687994de4ee2 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:31.071639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-534bf735-f386-458e-b674-687994de4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:31.080969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1079/2175] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:31.096282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009e50b-c7bd-4ca7-8ce0-9df0cf18a7a7 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:31.107723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009e50b-c7bd-4ca7-8ce0-9df0cf18a7a7 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:31.113966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0767e5-aedd-470c-b5d9-c188ad535a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:31.114557 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0767e5-aedd-470c-b5d9-c188ad535a85 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:31.114840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0767e5-aedd-470c-b5d9-c188ad535a85 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:31.115126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0767e5-aedd-470c-b5d9-c188ad535a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:31.123375 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0767e5-aedd-470c-b5d9-c188ad535a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:31.124970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0767e5-aedd-470c-b5d9-c188ad535a85 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:31.134755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1097/2176] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:49:35.245603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a1b38-c08d-49de-a4f0-0c0090b7d5f6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:35.246106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a1b38-c08d-49de-a4f0-0c0090b7d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:35.246106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a1b38-c08d-49de-a4f0-0c0090b7d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:35.266252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d25a1b38-c08d-49de-a4f0-0c0090b7d5f6 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:35.267466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d25a1b38-c08d-49de-a4f0-0c0090b7d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:35.275547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1080/2177] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:35.291290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0767e5-aedd-470c-b5d9-c188ad535a85 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:35.302803 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0767e5-aedd-470c-b5d9-c188ad535a85 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:35.308744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8fa85-43e2-405d-af9c-2dae1850a737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:35.309318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8fa85-43e2-405d-af9c-2dae1850a737 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:35.309590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8fa85-43e2-405d-af9c-2dae1850a737 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:35.309855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8fa85-43e2-405d-af9c-2dae1850a737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:35.318108 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8fa85-43e2-405d-af9c-2dae1850a737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:35.319730 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8fa85-43e2-405d-af9c-2dae1850a737 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:35.329003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1098/2178] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:49:38.210370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac0d45-47a2-4417-9a89-3f21fa7eca53 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:38.211328 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac0d45-47a2-4417-9a89-3f21fa7eca53 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:38.211328 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac0d45-47a2-4417-9a89-3f21fa7eca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:38.231001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e8ac0d45-47a2-4417-9a89-3f21fa7eca53 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:38.232214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e8ac0d45-47a2-4417-9a89-3f21fa7eca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:38.290811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1081/2179] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:49:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:38.345644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8fa85-43e2-405d-af9c-2dae1850a737 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:38.347289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cee8fa85-43e2-405d-af9c-2dae1850a737 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:38.421205 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8fa85-43e2-405d-af9c-2dae1850a737 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:38.427144 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f74d3-b779-4807-89b1-704992cdacd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:38.427739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f74d3-b779-4807-89b1-704992cdacd7 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:38.428012 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f74d3-b779-4807-89b1-704992cdacd7 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:38.428277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f74d3-b779-4807-89b1-704992cdacd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:38.435081 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:38.437529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f74d3-b779-4807-89b1-704992cdacd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:38.439466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f74d3-b779-4807-89b1-704992cdacd7 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:38.447977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1099/2180] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:49:48.283248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=43 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:48.444558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:51.892620 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d9bba-cbb9-4560-9ad4-5f41eab09509 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:51.893546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d9bba-cbb9-4560-9ad4-5f41eab09509 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:51.893546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d9bba-cbb9-4560-9ad4-5f41eab09509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:51.922145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-833d9bba-cbb9-4560-9ad4-5f41eab09509 None None] MFA Rules not processed for user `7cfdf248e9be4ac985d7a4b48b940a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:51.923386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-833d9bba-cbb9-4560-9ad4-5f41eab09509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:51.932169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1082/2181] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:53.797518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5e7f-6aca-4cb2-8451-ccfc9c4e9dd0 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:53.798443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5e7f-6aca-4cb2-8451-ccfc9c4e9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:53.798830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5e7f-6aca-4cb2-8451-ccfc9c4e9dd0 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:53.800308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1100/2182] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:49:53.806897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804435d5-d54d-4c03-be35-7194e77d5d3f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:53.807483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804435d5-d54d-4c03-be35-7194e77d5d3f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:53.807630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804435d5-d54d-4c03-be35-7194e77d5d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:53.830323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-804435d5-d54d-4c03-be35-7194e77d5d3f None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:53.831716 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-804435d5-d54d-4c03-be35-7194e77d5d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:53.842470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1083/2183] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:49:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:53.854833 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5e7f-6aca-4cb2-8451-ccfc9c4e9dd0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:53.856700 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1b3d5e7f-6aca-4cb2-8451-ccfc9c4e9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:53.927666 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5e7f-6aca-4cb2-8451-ccfc9c4e9dd0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:53.931815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00545d25-aeca-4b8b-ae05-28d2f4424a0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8ec9210f54c6698477d7dbbe46a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:53.932684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00545d25-aeca-4b8b-ae05-28d2f4424a0c service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:53.933166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00545d25-aeca-4b8b-ae05-28d2f4424a0c service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:53.933582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00545d25-aeca-4b8b-ae05-28d2f4424a0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:53.949711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00545d25-aeca-4b8b-ae05-28d2f4424a0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:53.951194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00545d25-aeca-4b8b-ae05-28d2f4424a0c service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:53.962695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1101/2184] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:49:54.046284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ebfc-78af-48ef-911d-a2dc049eac34 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:54.046570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ebfc-78af-48ef-911d-a2dc049eac34 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:54.046758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ebfc-78af-48ef-911d-a2dc049eac34 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:54.048309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1084/2185] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:49:54.057973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b2f0-127f-46f7-bb3e-41f5bdacce06 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:54.059072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b2f0-127f-46f7-bb3e-41f5bdacce06 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:54.059428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b2f0-127f-46f7-bb3e-41f5bdacce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:54.081570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5694b2f0-127f-46f7-bb3e-41f5bdacce06 None None] MFA Rules not processed for user `fe801da792944be2b6342c483bcb88b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:54.082851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5694b2f0-127f-46f7-bb3e-41f5bdacce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:54.090872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1102/2186] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:49:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:54.109326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ebfc-78af-48ef-911d-a2dc049eac34 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:54.125425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ebfc-78af-48ef-911d-a2dc049eac34 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:54.131031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e0b74-4307-4801-ba43-551d25049597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:54.131821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e0b74-4307-4801-ba43-551d25049597 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:54.132745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e0b74-4307-4801-ba43-551d25049597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:54.133117 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e0b74-4307-4801-ba43-551d25049597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:54.142220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e0b74-4307-4801-ba43-551d25049597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:54.143769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e0b74-4307-4801-ba43-551d25049597 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:54.153331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1085/2187] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:49:54.244289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2ee1b-57af-410f-98ac-1b01f5c58fb3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:54.244572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2ee1b-57af-410f-98ac-1b01f5c58fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:54.244848 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2ee1b-57af-410f-98ac-1b01f5c58fb3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:54.246283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1103/2188] 10.222.0.46 () {54 vars in 921 bytes} [Mon Oct 24 13:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:49:54.254132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3025472-4abb-4a76-8656-43dc1db1d926 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:54.254415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3025472-4abb-4a76-8656-43dc1db1d926 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:54.254678 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3025472-4abb-4a76-8656-43dc1db1d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:54.274892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f3025472-4abb-4a76-8656-43dc1db1d926 None None] MFA Rules not processed for user `3f5b069b5307470e96176481702d6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:54.276172 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f3025472-4abb-4a76-8656-43dc1db1d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:54.285632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1086/2189] 10.222.0.46 () {58 vars in 1018 bytes} [Mon Oct 24 13:49:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:54.296930 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2ee1b-57af-410f-98ac-1b01f5c58fb3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:54.299637 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-12e2ee1b-57af-410f-98ac-1b01f5c58fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:54.313630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2ee1b-57af-410f-98ac-1b01f5c58fb3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:54.317150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c453a-ed32-4e87-af2b-062e1cc37be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:54.317738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c453a-ed32-4e87-af2b-062e1cc37be8 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:54.318005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c453a-ed32-4e87-af2b-062e1cc37be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:54.318274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c453a-ed32-4e87-af2b-062e1cc37be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:54.328808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c453a-ed32-4e87-af2b-062e1cc37be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:54.330241 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c453a-ed32-4e87-af2b-062e1cc37be8 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:54.340909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1104/2190] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:49:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:49:58.222893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44dfb5-1069-4310-a86d-cd4fffce7e8b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:58.223462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44dfb5-1069-4310-a86d-cd4fffce7e8b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:58.223675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44dfb5-1069-4310-a86d-cd4fffce7e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:58.244697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-cd44dfb5-1069-4310-a86d-cd4fffce7e8b None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:49:58.245923 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cd44dfb5-1069-4310-a86d-cd4fffce7e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:49:58.253976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1087/2191] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:49:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:49:58.266252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c453a-ed32-4e87-af2b-062e1cc37be8 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:49:58.278158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c453a-ed32-4e87-af2b-062e1cc37be8 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:49:58.283152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e41e34-eafe-4e7b-8989-d2ee2248d56f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:49:58.283821 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e41e34-eafe-4e7b-8989-d2ee2248d56f service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:49:58.284153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e41e34-eafe-4e7b-8989-d2ee2248d56f service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:49:58.284480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e41e34-eafe-4e7b-8989-d2ee2248d56f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:49:58.293152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e41e34-eafe-4e7b-8989-d2ee2248d56f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:49:58.294792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e41e34-eafe-4e7b-8989-d2ee2248d56f service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:49:58.303015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1105/2192] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:49:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:50:08.239590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=18 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:08.299621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=41 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:18.649063 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6440a-707d-44fa-a873-b3633d3ddf35 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:18.649603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6440a-707d-44fa-a873-b3633d3ddf35 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:18.649603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6440a-707d-44fa-a873-b3633d3ddf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:18.690869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7bb6440a-707d-44fa-a873-b3633d3ddf35 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:18.692108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7bb6440a-707d-44fa-a873-b3633d3ddf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:18.726636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1088/2193] 10.222.0.46 () {58 vars in 967 bytes} [Mon Oct 24 13:50:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:18.739734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e41e34-eafe-4e7b-8989-d2ee2248d56f service swift] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:18.782128 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e41e34-eafe-4e7b-8989-d2ee2248d56f service swift] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:18.787853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3b95e-7e1f-4911-95ba-882145f982b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:18.788451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b95e-7e1f-4911-95ba-882145f982b9 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:18.788726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b95e-7e1f-4911-95ba-882145f982b9 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:18.788996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b95e-7e1f-4911-95ba-882145f982b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:18.797388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3b95e-7e1f-4911-95ba-882145f982b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:18.798981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3b95e-7e1f-4911-95ba-882145f982b9 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:18.807377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1106/2194] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:50:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:50:19.657353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6440a-707d-44fa-a873-b3633d3ddf35 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:19.659590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7bb6440a-707d-44fa-a873-b3633d3ddf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:19.778561 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6440a-707d-44fa-a873-b3633d3ddf35 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:19.784540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fde6b8-8b5e-46e3-939d-0c558ca018bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:19.785508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde6b8-8b5e-46e3-939d-0c558ca018bd service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:19.785974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde6b8-8b5e-46e3-939d-0c558ca018bd service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:19.786312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde6b8-8b5e-46e3-939d-0c558ca018bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:19.788361 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f5fde6b8-8b5e-46e3-939d-0c558ca018bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:19.801725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fde6b8-8b5e-46e3-939d-0c558ca018bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:19.803717 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fde6b8-8b5e-46e3-939d-0c558ca018bd service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:19.814835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1089/2195] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:50:20.624121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdae9c7-17fc-489d-9b40-aee9d23b9866 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:20.624745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdae9c7-17fc-489d-9b40-aee9d23b9866 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:20.624845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdae9c7-17fc-489d-9b40-aee9d23b9866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:20.700961 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ecdae9c7-17fc-489d-9b40-aee9d23b9866 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:20.702212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ecdae9c7-17fc-489d-9b40-aee9d23b9866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:20.732315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1107/2196] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:20.751967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fde6b8-8b5e-46e3-939d-0c558ca018bd service placement] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:20.775732 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fde6b8-8b5e-46e3-939d-0c558ca018bd service placement] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:20.781760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648eb4f-a348-45bf-8469-3e9828674209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:20.782364 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648eb4f-a348-45bf-8469-3e9828674209 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:20.782639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648eb4f-a348-45bf-8469-3e9828674209 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:20.782910 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648eb4f-a348-45bf-8469-3e9828674209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:20.791804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648eb4f-a348-45bf-8469-3e9828674209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:20.793356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648eb4f-a348-45bf-8469-3e9828674209 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:20.803130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1090/2197] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:24.963620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f4a45-2361-4448-b73b-0d9d8164958f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:24.964133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f4a45-2361-4448-b73b-0d9d8164958f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:24.964133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f4a45-2361-4448-b73b-0d9d8164958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:24.985514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b61f4a45-2361-4448-b73b-0d9d8164958f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:24.986730 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b61f4a45-2361-4448-b73b-0d9d8164958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:24.995578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1108/2198] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:25.009917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648eb4f-a348-45bf-8469-3e9828674209 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:25.022011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648eb4f-a348-45bf-8469-3e9828674209 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:25.027823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707928db-f23c-4057-bf8f-16afeba4bebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:25.028417 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707928db-f23c-4057-bf8f-16afeba4bebf service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:25.028850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707928db-f23c-4057-bf8f-16afeba4bebf service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:25.029121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707928db-f23c-4057-bf8f-16afeba4bebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:25.039279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707928db-f23c-4057-bf8f-16afeba4bebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:25.040838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707928db-f23c-4057-bf8f-16afeba4bebf service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:25.050402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1091/2199] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:29.126726 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471cfb9-354a-4323-8ebe-fe9b7945a45b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:29.127254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471cfb9-354a-4323-8ebe-fe9b7945a45b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:29.127254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471cfb9-354a-4323-8ebe-fe9b7945a45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:29.148553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6471cfb9-354a-4323-8ebe-fe9b7945a45b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:29.149767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6471cfb9-354a-4323-8ebe-fe9b7945a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:29.161281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1109/2200] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:29.177595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707928db-f23c-4057-bf8f-16afeba4bebf service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:29.193750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707928db-f23c-4057-bf8f-16afeba4bebf service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:29.202087 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e9ef-27eb-4bf3-929e-17d5cf31c88f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:29.202609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e9ef-27eb-4bf3-929e-17d5cf31c88f service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:29.202877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e9ef-27eb-4bf3-929e-17d5cf31c88f service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:29.203165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e9ef-27eb-4bf3-929e-17d5cf31c88f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:29.212156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112e9ef-27eb-4bf3-929e-17d5cf31c88f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:29.213707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112e9ef-27eb-4bf3-929e-17d5cf31c88f service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:29.223447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1092/2201] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:33.310982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0514636-c3a5-416c-8e00-891affce667a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:33.311501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0514636-c3a5-416c-8e00-891affce667a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:33.311501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0514636-c3a5-416c-8e00-891affce667a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:33.336657 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c0514636-c3a5-416c-8e00-891affce667a None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:33.337869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c0514636-c3a5-416c-8e00-891affce667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:33.347449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1110/2202] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:33.366673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e9ef-27eb-4bf3-929e-17d5cf31c88f service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:33.379221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e9ef-27eb-4bf3-929e-17d5cf31c88f service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:33.386724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd8bc4-5735-4fa0-9759-45dfc0be6492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:33.387382 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd8bc4-5735-4fa0-9759-45dfc0be6492 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:33.387652 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd8bc4-5735-4fa0-9759-45dfc0be6492 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:33.387914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd8bc4-5735-4fa0-9759-45dfc0be6492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:33.397186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd8bc4-5735-4fa0-9759-45dfc0be6492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:33.398774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd8bc4-5735-4fa0-9759-45dfc0be6492 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:33.408313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1093/2203] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:36.591131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0514636-c3a5-416c-8e00-891affce667a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:36.611630 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0514636-c3a5-416c-8e00-891affce667a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:36.615487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01822fd-04b4-477e-84bd-38034921c5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:36.616086 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01822fd-04b4-477e-84bd-38034921c5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:36.616540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01822fd-04b4-477e-84bd-38034921c5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:36.616807 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01822fd-04b4-477e-84bd-38034921c5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:36.618636 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f01822fd-04b4-477e-84bd-38034921c5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:36.632284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01822fd-04b4-477e-84bd-38034921c5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:36.633755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01822fd-04b4-477e-84bd-38034921c5f6 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:36.644129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1111/2204] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:37.528612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0820-be09-417b-a02f-fc2482d688bf None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:37.529595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0820-be09-417b-a02f-fc2482d688bf None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:37.530101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0820-be09-417b-a02f-fc2482d688bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:37.561781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7edc0820-be09-417b-a02f-fc2482d688bf None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:37.563034 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7edc0820-be09-417b-a02f-fc2482d688bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:37.572254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1094/2205] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 24 13:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:37.588384 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01822fd-04b4-477e-84bd-38034921c5f6 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:37.603554 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01822fd-04b4-477e-84bd-38034921c5f6 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:37.617074 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8768-1adb-4be4-98fa-ab3f9182762e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:37.617887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8768-1adb-4be4-98fa-ab3f9182762e service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:37.618229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8768-1adb-4be4-98fa-ab3f9182762e service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:37.618497 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8768-1adb-4be4-98fa-ab3f9182762e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:37.628360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e8768-1adb-4be4-98fa-ab3f9182762e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:37.630430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e8768-1adb-4be4-98fa-ab3f9182762e service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:37.641408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1112/2206] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:39.685323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0820-be09-417b-a02f-fc2482d688bf None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:39.687260 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7edc0820-be09-417b-a02f-fc2482d688bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:39.703794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0820-be09-417b-a02f-fc2482d688bf None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:39.708292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:39.708917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:39.709188 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:39.709452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] PATH_INFO: `/v3/users/447498c7fe844b5d8cc616d71c3ff7f8` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:39.710562 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=447498c7fe844b5d8cc616d71c3ff7f8)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:39.712496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:39.718066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:39.768217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447498c7fe844b5d8cc616d71c3ff7f8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:39.768952 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447498c7fe844b5d8cc616d71c3ff7f8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:39.775914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447498c7fe844b5d8cc616d71c3ff7f8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:39.788999 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447498c7fe844b5d8cc616d71c3ff7f8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:39.789695 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-59029e14-5daf-49b2-afea-1cca2ffe7ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447498c7fe844b5d8cc616d71c3ff7f8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:39.803698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1095/2207] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:50:39 2022] DELETE /identity/v3/users/447498c7fe844b5d8cc616d71c3ff7f8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:39.991810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8768-1adb-4be4-98fa-ab3f9182762e service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:40.002764 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8768-1adb-4be4-98fa-ab3f9182762e service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:40.054459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:40.062234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:40.062869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.063175 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.063442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] PATH_INFO: `/v3/projects/7a94849f13944b45a3500937b6af40d3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.064568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a94849f13944b45a3500937b6af40d3)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:40.066480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:40.116706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a94849f13944b45a3500937b6af40d3', 'request_id': 'req-febde37c-9c29-40ad-990c-83c0d3ab45df'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:40.122577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a94849f13944b45a3500937b6af40d3', 'request_id': 'req-febde37c-9c29-40ad-990c-83c0d3ab45df'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:40.129550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a94849f13944b45a3500937b6af40d3', 'request_id': 'req-febde37c-9c29-40ad-990c-83c0d3ab45df'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:40.148055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] The token cache is being invalidate because project 7a94849f13944b45a3500937b6af40d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:50:40.148397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:40.149393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-febde37c-9c29-40ad-990c-83c0d3ab45df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:40.151422 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1113/2208] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:50:39 2022] DELETE /identity/v3/projects/7a94849f13944b45a3500937b6af40d3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:40.156680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b86752-cef6-4b34-9231-d0b7447a4f73 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.156963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b86752-cef6-4b34-9231-d0b7447a4f73 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.157235 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b86752-cef6-4b34-9231-d0b7447a4f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.177354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-69b86752-cef6-4b34-9231-d0b7447a4f73 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:40.178553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-69b86752-cef6-4b34-9231-d0b7447a4f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:40.238862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1096/2209] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:40.247382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff79169-a3d8-4cc9-b594-e67867838c81 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.247670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff79169-a3d8-4cc9-b594-e67867838c81 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.247943 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff79169-a3d8-4cc9-b594-e67867838c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.271226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3ff79169-a3d8-4cc9-b594-e67867838c81 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:40.272434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3ff79169-a3d8-4cc9-b594-e67867838c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:40.283555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1114/2210] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:40.288848 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b86752-cef6-4b34-9231-d0b7447a4f73 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:40.304903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b86752-cef6-4b34-9231-d0b7447a4f73 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:40.312150 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26ecd6-cde4-4f80-91a8-bac5b327b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:40.312773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ecd6-cde4-4f80-91a8-bac5b327b85a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.313042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ecd6-cde4-4f80-91a8-bac5b327b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.313303 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ecd6-cde4-4f80-91a8-bac5b327b85a admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.313953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26ecd6-cde4-4f80-91a8-bac5b327b85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:50:40.314261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26ecd6-cde4-4f80-91a8-bac5b327b85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:40.315913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26ecd6-cde4-4f80-91a8-bac5b327b85a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:40.330826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1097/2211] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:50:40.335487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff79169-a3d8-4cc9-b594-e67867838c81 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:40.348827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff79169-a3d8-4cc9-b594-e67867838c81 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:40.354975 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3398c-e2ed-4f3f-842d-2b09929cc453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:40.355614 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3398c-e2ed-4f3f-842d-2b09929cc453 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.355893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3398c-e2ed-4f3f-842d-2b09929cc453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.356163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3398c-e2ed-4f3f-842d-2b09929cc453 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.356797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3398c-e2ed-4f3f-842d-2b09929cc453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:40.358782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3398c-e2ed-4f3f-842d-2b09929cc453 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:40.397304 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1115/2212] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:50:40 2022] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:50:40.402009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26ecd6-cde4-4f80-91a8-bac5b327b85a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:40.414012 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26ecd6-cde4-4f80-91a8-bac5b327b85a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:40.486938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9217b45-6999-404d-b9c3-097ca80ff67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:40.487576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217b45-6999-404d-b9c3-097ca80ff67b admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.487846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217b45-6999-404d-b9c3-097ca80ff67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.488115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217b45-6999-404d-b9c3-097ca80ff67b admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.488759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9217b45-6999-404d-b9c3-097ca80ff67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:40.490671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9217b45-6999-404d-b9c3-097ca80ff67b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:40.512187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:40.523558 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1098/2213] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:50:40 2022] POST /identity/v3/users => generated 302 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:50:40.524805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3398c-e2ed-4f3f-842d-2b09929cc453 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:40.541378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3398c-e2ed-4f3f-842d-2b09929cc453 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:40.546973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f605c86-d198-4e77-b25a-b39df0b23ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:40.547569 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f605c86-d198-4e77-b25a-b39df0b23ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.547839 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f605c86-d198-4e77-b25a-b39df0b23ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.548101 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f605c86-d198-4e77-b25a-b39df0b23ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.548736 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f605c86-d198-4e77-b25a-b39df0b23ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:40.550315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f605c86-d198-4e77-b25a-b39df0b23ad2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:40.562367 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1116/2214] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:50:40.567489 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9217b45-6999-404d-b9c3-097ca80ff67b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:40.579700 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9217b45-6999-404d-b9c3-097ca80ff67b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:40.587028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a758e94-4cc2-4727-a7cd-39c8d5864a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:40.587677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a758e94-4cc2-4727-a7cd-39c8d5864a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.587948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a758e94-4cc2-4727-a7cd-39c8d5864a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.588220 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a758e94-4cc2-4727-a7cd-39c8d5864a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.588913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a758e94-4cc2-4727-a7cd-39c8d5864a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:40.591698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a758e94-4cc2-4727-a7cd-39c8d5864a22 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:40.610531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1099/2215] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:50:40.611682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f605c86-d198-4e77-b25a-b39df0b23ad2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:40.623692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f605c86-d198-4e77-b25a-b39df0b23ad2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:40.629151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8d8c-0325-44dc-969a-8c4726eb6812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:40.630071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8d8c-0325-44dc-969a-8c4726eb6812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.630329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8d8c-0325-44dc-969a-8c4726eb6812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.630599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8d8c-0325-44dc-969a-8c4726eb6812 admin admin] PATH_INFO: `/v3/projects/352484efb95f4cbbb67526a8b6fa5223/users/960026110c8e4c4d9b377266031946ff/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.648008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b8d8c-0325-44dc-969a-8c4726eb6812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352484efb95f4cbbb67526a8b6fa5223, user_id=960026110c8e4c4d9b377266031946ff, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:40.650566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b8d8c-0325-44dc-969a-8c4726eb6812 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:40.668936 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1117/2216] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:50:40 2022] PUT /identity/v3/projects/352484efb95f4cbbb67526a8b6fa5223/users/960026110c8e4c4d9b377266031946ff/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:40.675958 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73624837-b38f-43d4-93b2-17b14ba8c4fa None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.676331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73624837-b38f-43d4-93b2-17b14ba8c4fa None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.676719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73624837-b38f-43d4-93b2-17b14ba8c4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.702613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-73624837-b38f-43d4-93b2-17b14ba8c4fa None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:40.703878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-73624837-b38f-43d4-93b2-17b14ba8c4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:40.781631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1100/2217] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:40.792672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8d8c-0325-44dc-969a-8c4726eb6812 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:40.794691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-027b8d8c-0325-44dc-969a-8c4726eb6812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:40.893093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8d8c-0325-44dc-969a-8c4726eb6812 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:40.897808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d04f1-cc4d-4210-8fd4-961ccfe6934b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:40.898656 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d04f1-cc4d-4210-8fd4-961ccfe6934b service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:40.898876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d04f1-cc4d-4210-8fd4-961ccfe6934b service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:40.899170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d04f1-cc4d-4210-8fd4-961ccfe6934b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:40.911917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d04f1-cc4d-4210-8fd4-961ccfe6934b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:40.914483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d04f1-cc4d-4210-8fd4-961ccfe6934b service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:40.927203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1118/2218] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:41.628651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d8ecd-c829-4391-b251-9bd3fecec3c1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:41.628960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d8ecd-c829-4391-b251-9bd3fecec3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:41.629619 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d8ecd-c829-4391-b251-9bd3fecec3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:41.662269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-db5d8ecd-c829-4391-b251-9bd3fecec3c1 None None] MFA Rules not processed for user `960026110c8e4c4d9b377266031946ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:41.663651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-db5d8ecd-c829-4391-b251-9bd3fecec3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:41.745681 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1101/2219] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:50:41 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:41.747498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d04f1-cc4d-4210-8fd4-961ccfe6934b service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:41.760230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d04f1-cc4d-4210-8fd4-961ccfe6934b service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:41.765354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415d2bf-370d-46ce-8d75-197e12be62ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:41.766110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415d2bf-370d-46ce-8d75-197e12be62ab admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:41.766565 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415d2bf-370d-46ce-8d75-197e12be62ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:41.766950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415d2bf-370d-46ce-8d75-197e12be62ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:41.767708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415d2bf-370d-46ce-8d75-197e12be62ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:41.770574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415d2bf-370d-46ce-8d75-197e12be62ab admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:41.784705 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:41.808752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1119/2220] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:50:41 2022] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:50:41.813505 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d8ecd-c829-4391-b251-9bd3fecec3c1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:41.825811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d8ecd-c829-4391-b251-9bd3fecec3c1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:41.892819 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8ead-8e3b-4b7a-acd9-818864898253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:41.893592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8ead-8e3b-4b7a-acd9-818864898253 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:41.893862 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8ead-8e3b-4b7a-acd9-818864898253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:41.894133 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8ead-8e3b-4b7a-acd9-818864898253 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:41.894767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f8ead-8e3b-4b7a-acd9-818864898253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:41.896774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f8ead-8e3b-4b7a-acd9-818864898253 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:41.936698 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1102/2221] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:50:41 2022] POST /identity/v3/users => generated 308 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:50:41.937897 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415d2bf-370d-46ce-8d75-197e12be62ab admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:41.948300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415d2bf-370d-46ce-8d75-197e12be62ab admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:41.953088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4860c9-c85c-4b8f-b055-267fafbb0aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:41.953694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4860c9-c85c-4b8f-b055-267fafbb0aad admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:41.953973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4860c9-c85c-4b8f-b055-267fafbb0aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:41.954246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4860c9-c85c-4b8f-b055-267fafbb0aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:41.954886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4860c9-c85c-4b8f-b055-267fafbb0aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:41.956586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4860c9-c85c-4b8f-b055-267fafbb0aad admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:41.970130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1120/2222] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:50:41.971981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8ead-8e3b-4b7a-acd9-818864898253 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:41.981878 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8ead-8e3b-4b7a-acd9-818864898253 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:41.987675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d71633-6b0b-49d2-b3c0-7552094facae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:41.988415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71633-6b0b-49d2-b3c0-7552094facae admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:41.988790 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71633-6b0b-49d2-b3c0-7552094facae admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:41.989254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71633-6b0b-49d2-b3c0-7552094facae admin admin] PATH_INFO: `/v3/projects/eb733411636f4b0bb002687d0fe5ce31/users/a5e55344d4ba46ca90e175c1b891cd41/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:41.992707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:42.006788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d71633-6b0b-49d2-b3c0-7552094facae admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb733411636f4b0bb002687d0fe5ce31, user_id=a5e55344d4ba46ca90e175c1b891cd41, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:42.009494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d71633-6b0b-49d2-b3c0-7552094facae admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:42.024233 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1103/2223] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:50:41 2022] PUT /identity/v3/projects/eb733411636f4b0bb002687d0fe5ce31/users/a5e55344d4ba46ca90e175c1b891cd41/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:50:42.028291 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4860c9-c85c-4b8f-b055-267fafbb0aad admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:42.038621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4860c9-c85c-4b8f-b055-267fafbb0aad admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:42.096981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0f535-1520-4540-a25a-2480fd6be616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:42.097674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0f535-1520-4540-a25a-2480fd6be616 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:42.097953 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0f535-1520-4540-a25a-2480fd6be616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:42.098224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0f535-1520-4540-a25a-2480fd6be616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:42.098860 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0f535-1520-4540-a25a-2480fd6be616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:42.100515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0f535-1520-4540-a25a-2480fd6be616 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:42.110974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1121/2224] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:50:42.115299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d71633-6b0b-49d2-b3c0-7552094facae admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:42.125781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d71633-6b0b-49d2-b3c0-7552094facae admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:42.131392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bfe1-282c-4d5a-bae2-fdcefd772cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:42.132041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bfe1-282c-4d5a-bae2-fdcefd772cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:42.132314 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bfe1-282c-4d5a-bae2-fdcefd772cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:42.132577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bfe1-282c-4d5a-bae2-fdcefd772cd8 admin admin] PATH_INFO: `/v3/projects/eb733411636f4b0bb002687d0fe5ce31/users/a5e55344d4ba46ca90e175c1b891cd41/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:42.134597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11bfe1-282c-4d5a-bae2-fdcefd772cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb733411636f4b0bb002687d0fe5ce31, user_id=a5e55344d4ba46ca90e175c1b891cd41, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:42.137233 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11bfe1-282c-4d5a-bae2-fdcefd772cd8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:42.148213 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1104/2225] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:50:42 2022] PUT /identity/v3/projects/eb733411636f4b0bb002687d0fe5ce31/users/a5e55344d4ba46ca90e175c1b891cd41/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:43.343544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c42b5c-c633-4290-bc8b-7c1efaf0c07f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:43.344123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c42b5c-c633-4290-bc8b-7c1efaf0c07f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:43.344123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c42b5c-c633-4290-bc8b-7c1efaf0c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:43.371584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-02c42b5c-c633-4290-bc8b-7c1efaf0c07f None None] MFA Rules not processed for user `a5e55344d4ba46ca90e175c1b891cd41`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:43.372787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-02c42b5c-c633-4290-bc8b-7c1efaf0c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:43.445960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1122/2226] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:50:43 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:44.459965 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bfe1-282c-4d5a-bae2-fdcefd772cd8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:44.461819 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7a11bfe1-282c-4d5a-bae2-fdcefd772cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:44.516559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c42b5c-c633-4290-bc8b-7c1efaf0c07f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:44.579122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bfe1-282c-4d5a-bae2-fdcefd772cd8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:44.581270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c42b5c-c633-4290-bc8b-7c1efaf0c07f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:44.584108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19141831-fca9-422f-8c11-a9811b8d22f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:44.584711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19141831-fca9-422f-8c11-a9811b8d22f5 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:44.584982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19141831-fca9-422f-8c11-a9811b8d22f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:44.585252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19141831-fca9-422f-8c11-a9811b8d22f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:44.585793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:44.586413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:44.586682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:44.586981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] PATH_INFO: `/v3/users/960026110c8e4c4d9b377266031946ff` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:44.587094 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-19141831-fca9-422f-8c11-a9811b8d22f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:44.588077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=960026110c8e4c4d9b377266031946ff)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:44.590009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:44.592426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:44.598780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19141831-fca9-422f-8c11-a9811b8d22f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:44.600381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19141831-fca9-422f-8c11-a9811b8d22f5 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:44.610809 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1105/2227] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:44.644968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960026110c8e4c4d9b377266031946ff'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:44.645611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960026110c8e4c4d9b377266031946ff'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:44.652562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960026110c8e4c4d9b377266031946ff'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:44.664070 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960026110c8e4c4d9b377266031946ff'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:44.664689 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960026110c8e4c4d9b377266031946ff'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:44.678907 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1123/2228] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:50:44 2022] DELETE /identity/v3/users/960026110c8e4c4d9b377266031946ff => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:44.860658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19141831-fca9-422f-8c11-a9811b8d22f5 service placement] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:44.871797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19141831-fca9-422f-8c11-a9811b8d22f5 service placement] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:44.929086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:44.929707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:44.929973 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:44.930236 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] PATH_INFO: `/v3/projects/352484efb95f4cbbb67526a8b6fa5223` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:44.931446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352484efb95f4cbbb67526a8b6fa5223)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:44.933339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:44.982761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352484efb95f4cbbb67526a8b6fa5223', 'request_id': 'req-49b21a99-f198-4171-9962-19a5f4f33409'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:44.989011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352484efb95f4cbbb67526a8b6fa5223', 'request_id': 'req-49b21a99-f198-4171-9962-19a5f4f33409'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:44.994608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352484efb95f4cbbb67526a8b6fa5223', 'request_id': 'req-49b21a99-f198-4171-9962-19a5f4f33409'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:44.996286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:45.010346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] The token cache is being invalidate because project 352484efb95f4cbbb67526a8b6fa5223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:50:45.010633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.011271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.012766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1106/2229] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:50:44 2022] DELETE /identity/v3/projects/352484efb95f4cbbb67526a8b6fa5223 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:45.016845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:45.018341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:45.031382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75626fd8-9044-4d7b-a6b8-22d0f3f50fab admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:45.090381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:45.091212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.091496 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.091806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] PATH_INFO: `/v3/users/a5e55344d4ba46ca90e175c1b891cd41` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.093104 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e55344d4ba46ca90e175c1b891cd41)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:45.095135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:45.147869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e55344d4ba46ca90e175c1b891cd41'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.148533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e55344d4ba46ca90e175c1b891cd41'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.155844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e55344d4ba46ca90e175c1b891cd41'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.167446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e55344d4ba46ca90e175c1b891cd41'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.168094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f977b067-45ee-454b-9a4f-e45dc9703300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e55344d4ba46ca90e175c1b891cd41'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.179247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:45.184080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1124/2230] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:50:45 2022] DELETE /identity/v3/users/a5e55344d4ba46ca90e175c1b891cd41 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:45.365998 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:45.367642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:45.387927 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b21a99-f198-4171-9962-19a5f4f33409 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:45.447054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:45.447629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.447899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.448161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] PATH_INFO: `/v3/projects/eb733411636f4b0bb002687d0fe5ce31` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.449300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb733411636f4b0bb002687d0fe5ce31)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:45.451258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:45.508430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb733411636f4b0bb002687d0fe5ce31', 'request_id': 'req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.514496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb733411636f4b0bb002687d0fe5ce31', 'request_id': 'req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.520713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb733411636f4b0bb002687d0fe5ce31', 'request_id': 'req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.536808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] The token cache is being invalidate because project eb733411636f4b0bb002687d0fe5ce31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:50:45.537092 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.537737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-08d4d36c-0feb-43a1-b1c2-dbd8b9e16668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:50:45.539298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1107/2231] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:50:45 2022] DELETE /identity/v3/projects/eb733411636f4b0bb002687d0fe5ce31 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:45.544246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ffc12-c4f3-4cc2-bb0d-aad685c4a1cb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.544724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ffc12-c4f3-4cc2-bb0d-aad685c4a1cb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.544942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ffc12-c4f3-4cc2-bb0d-aad685c4a1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.566211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-052ffc12-c4f3-4cc2-bb0d-aad685c4a1cb None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:45.567434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-052ffc12-c4f3-4cc2-bb0d-aad685c4a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:45.633273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1125/2232] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:50:45.641199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf03be4-35e7-4537-9839-3d17f246bdec None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.641492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf03be4-35e7-4537-9839-3d17f246bdec None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.641762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf03be4-35e7-4537-9839-3d17f246bdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.662481 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-caf03be4-35e7-4537-9839-3d17f246bdec None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:45.663900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-caf03be4-35e7-4537-9839-3d17f246bdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:45.672179 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1108/2233] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:45.676551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ffc12-c4f3-4cc2-bb0d-aad685c4a1cb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:45.687337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ffc12-c4f3-4cc2-bb0d-aad685c4a1cb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:45.692978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f4820-9ea7-4a41-a596-e9583cc3b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:45.693722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4820-9ea7-4a41-a596-e9583cc3b8af admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.694061 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4820-9ea7-4a41-a596-e9583cc3b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.694397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4820-9ea7-4a41-a596-e9583cc3b8af admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.695139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f4820-9ea7-4a41-a596-e9583cc3b8af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:50:45.695524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f4820-9ea7-4a41-a596-e9583cc3b8af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:45.697382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f4820-9ea7-4a41-a596-e9583cc3b8af admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:45.709729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1126/2234] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:50:45.714197 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf03be4-35e7-4537-9839-3d17f246bdec None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:45.723675 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf03be4-35e7-4537-9839-3d17f246bdec None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:45.728574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703b56e-b7df-4aa5-ba5d-a5032f673fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:45.729170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b56e-b7df-4aa5-ba5d-a5032f673fbb admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.729448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b56e-b7df-4aa5-ba5d-a5032f673fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.729718 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b56e-b7df-4aa5-ba5d-a5032f673fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.730347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703b56e-b7df-4aa5-ba5d-a5032f673fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:45.732309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703b56e-b7df-4aa5-ba5d-a5032f673fbb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:45.762084 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1109/2235] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:50:45 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:50:45.766646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f4820-9ea7-4a41-a596-e9583cc3b8af admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:45.777055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f4820-9ea7-4a41-a596-e9583cc3b8af admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:45.834560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f562216-ca1b-46da-a993-f16bdcd4d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:45.835186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f562216-ca1b-46da-a993-f16bdcd4d680 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.835457 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f562216-ca1b-46da-a993-f16bdcd4d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.835724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f562216-ca1b-46da-a993-f16bdcd4d680 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.836350 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f562216-ca1b-46da-a993-f16bdcd4d680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:45.838254 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f562216-ca1b-46da-a993-f16bdcd4d680 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:45.862332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1127/2236] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:50:45 2022] POST /identity/v3/users => generated 278 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:50:45.866811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703b56e-b7df-4aa5-ba5d-a5032f673fbb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:45.877768 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703b56e-b7df-4aa5-ba5d-a5032f673fbb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:45.883317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03701db-f263-4feb-945f-4594f6aeec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:45.883909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03701db-f263-4feb-945f-4594f6aeec02 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.884179 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03701db-f263-4feb-945f-4594f6aeec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.884440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03701db-f263-4feb-945f-4594f6aeec02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.885071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03701db-f263-4feb-945f-4594f6aeec02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:45.886670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03701db-f263-4feb-945f-4594f6aeec02 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:45.896914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1110/2237] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:50:45.901397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f562216-ca1b-46da-a993-f16bdcd4d680 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:45.911838 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f562216-ca1b-46da-a993-f16bdcd4d680 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:45.916783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6bc54-4f07-43e0-83b4-a37da3d5d7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:45.917388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6bc54-4f07-43e0-83b4-a37da3d5d7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.917654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6bc54-4f07-43e0-83b4-a37da3d5d7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.917922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6bc54-4f07-43e0-83b4-a37da3d5d7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.918583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6bc54-4f07-43e0-83b4-a37da3d5d7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:45.920399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6bc54-4f07-43e0-83b4-a37da3d5d7e9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:45.931025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1128/2238] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:50:45.935264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03701db-f263-4feb-945f-4594f6aeec02 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:45.945511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03701db-f263-4feb-945f-4594f6aeec02 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:45.950445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83e7d-2fd9-4046-b486-477d3347df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:45.951054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83e7d-2fd9-4046-b486-477d3347df08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:45.951402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83e7d-2fd9-4046-b486-477d3347df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:45.951737 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83e7d-2fd9-4046-b486-477d3347df08 admin admin] PATH_INFO: `/v3/projects/7c419d6387c14f6da5fa8ec165934654/users/b03b827eba4e43f8bf5fd2f386bb84d9/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:45.966613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83e7d-2fd9-4046-b486-477d3347df08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c419d6387c14f6da5fa8ec165934654, user_id=b03b827eba4e43f8bf5fd2f386bb84d9, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:45.969283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83e7d-2fd9-4046-b486-477d3347df08 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:45.984783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1111/2239] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:50:45 2022] PUT /identity/v3/projects/7c419d6387c14f6da5fa8ec165934654/users/b03b827eba4e43f8bf5fd2f386bb84d9/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:45.999828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd312c-0292-493b-8a0a-8fef6d890c1b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.000117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd312c-0292-493b-8a0a-8fef6d890c1b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.000397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd312c-0292-493b-8a0a-8fef6d890c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.031041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c9cd312c-0292-493b-8a0a-8fef6d890c1b None None] MFA Rules not processed for user `b03b827eba4e43f8bf5fd2f386bb84d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:46.032299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c9cd312c-0292-493b-8a0a-8fef6d890c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:46.090021 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:46.100234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1129/2240] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:50:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:46.105006 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83e7d-2fd9-4046-b486-477d3347df08 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:46.124499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:46.170147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83e7d-2fd9-4046-b486-477d3347df08 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:46.175223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6196c1-f241-4cbf-8fe6-993da4136e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:46.175835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6196c1-f241-4cbf-8fe6-993da4136e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.176109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6196c1-f241-4cbf-8fe6-993da4136e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.176379 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6196c1-f241-4cbf-8fe6-993da4136e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.177026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6196c1-f241-4cbf-8fe6-993da4136e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:46.178949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6196c1-f241-4cbf-8fe6-993da4136e7a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:46.209022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1112/2241] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:50:46 2022] POST /identity/v3/projects => generated 357 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:50:46.214343 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd312c-0292-493b-8a0a-8fef6d890c1b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:46.225664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd312c-0292-493b-8a0a-8fef6d890c1b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:46.282118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2bff9-0d64-4887-9f8a-51e82a7a1f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:46.282719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2bff9-0d64-4887-9f8a-51e82a7a1f46 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.283017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2bff9-0d64-4887-9f8a-51e82a7a1f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.283279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2bff9-0d64-4887-9f8a-51e82a7a1f46 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.283901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2bff9-0d64-4887-9f8a-51e82a7a1f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:46.285817 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2bff9-0d64-4887-9f8a-51e82a7a1f46 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:46.308243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1130/2242] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:50:46 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:50:46.312526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6196c1-f241-4cbf-8fe6-993da4136e7a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:46.323327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6196c1-f241-4cbf-8fe6-993da4136e7a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:46.328476 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a872c-2b4c-4e29-ada5-034a7ab06a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:46.329077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a872c-2b4c-4e29-ada5-034a7ab06a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.329351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a872c-2b4c-4e29-ada5-034a7ab06a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.329621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a872c-2b4c-4e29-ada5-034a7ab06a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.330263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a872c-2b4c-4e29-ada5-034a7ab06a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:46.331906 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a872c-2b4c-4e29-ada5-034a7ab06a41 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:46.342929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1113/2243] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:50:46.347399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2bff9-0d64-4887-9f8a-51e82a7a1f46 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:46.358066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2bff9-0d64-4887-9f8a-51e82a7a1f46 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:46.364019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412e97-c46b-464e-9584-007852a23669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:46.364679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412e97-c46b-464e-9584-007852a23669 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.364951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412e97-c46b-464e-9584-007852a23669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.365222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412e97-c46b-464e-9584-007852a23669 admin admin] PATH_INFO: `/v3/projects/45922243b7fc4db9a792d43b4db74de0/users/125dc0871e1e4ae0b9c8b1517a24b8ea/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.382427 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34412e97-c46b-464e-9584-007852a23669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45922243b7fc4db9a792d43b4db74de0, user_id=125dc0871e1e4ae0b9c8b1517a24b8ea, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:46.385199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34412e97-c46b-464e-9584-007852a23669 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:46.401716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1131/2244] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:50:46 2022] PUT /identity/v3/projects/45922243b7fc4db9a792d43b4db74de0/users/125dc0871e1e4ae0b9c8b1517a24b8ea/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:50:46.405926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a872c-2b4c-4e29-ada5-034a7ab06a41 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:46.416086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a872c-2b4c-4e29-ada5-034a7ab06a41 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:46.479240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfcdbc-7a16-4245-aa7d-71202bacd89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:46.479759 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfcdbc-7a16-4245-aa7d-71202bacd89f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.480044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfcdbc-7a16-4245-aa7d-71202bacd89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.480310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfcdbc-7a16-4245-aa7d-71202bacd89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.480960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfcdbc-7a16-4245-aa7d-71202bacd89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:46.482658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfcdbc-7a16-4245-aa7d-71202bacd89f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:46.494005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1114/2245] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:50:46.498618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412e97-c46b-464e-9584-007852a23669 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:46.510183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412e97-c46b-464e-9584-007852a23669 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:46.515635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d06b89-212e-4964-9922-11e34e3eac48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:46.516281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d06b89-212e-4964-9922-11e34e3eac48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.516553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d06b89-212e-4964-9922-11e34e3eac48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.516830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d06b89-212e-4964-9922-11e34e3eac48 admin admin] PATH_INFO: `/v3/projects/45922243b7fc4db9a792d43b4db74de0/users/125dc0871e1e4ae0b9c8b1517a24b8ea/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.518962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d06b89-212e-4964-9922-11e34e3eac48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45922243b7fc4db9a792d43b4db74de0, user_id=125dc0871e1e4ae0b9c8b1517a24b8ea, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:46.521638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d06b89-212e-4964-9922-11e34e3eac48 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:46.533362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1132/2246] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:50:46 2022] PUT /identity/v3/projects/45922243b7fc4db9a792d43b4db74de0/users/125dc0871e1e4ae0b9c8b1517a24b8ea/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:50:46.543870 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344921c-d67d-4e72-b958-046d9af93e4c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.544430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344921c-d67d-4e72-b958-046d9af93e4c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.544430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344921c-d67d-4e72-b958-046d9af93e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.574351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c344921c-d67d-4e72-b958-046d9af93e4c None None] MFA Rules not processed for user `125dc0871e1e4ae0b9c8b1517a24b8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:50:46.575583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c344921c-d67d-4e72-b958-046d9af93e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:46.648313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1115/2247] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:50:46.663893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d06b89-212e-4964-9922-11e34e3eac48 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:46.665697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-59d06b89-212e-4964-9922-11e34e3eac48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:46.748113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d06b89-212e-4964-9922-11e34e3eac48 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:46.752387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76724354-4d32-418a-b621-e977896595f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:46.752986 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724354-4d32-418a-b621-e977896595f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.753258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724354-4d32-418a-b621-e977896595f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.753519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724354-4d32-418a-b621-e977896595f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.763308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76724354-4d32-418a-b621-e977896595f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:46.765000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76724354-4d32-418a-b621-e977896595f5 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:46.775193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1133/2248] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:46.855917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344921c-d67d-4e72-b958-046d9af93e4c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:46.865685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344921c-d67d-4e72-b958-046d9af93e4c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:46.869939 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f429db8-1a6f-4ef7-bba5-2d7ce5d2bbbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:46.870569 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f429db8-1a6f-4ef7-bba5-2d7ce5d2bbbe service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:46.870835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f429db8-1a6f-4ef7-bba5-2d7ce5d2bbbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:46.871138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f429db8-1a6f-4ef7-bba5-2d7ce5d2bbbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:46.881558 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:46.928599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f429db8-1a6f-4ef7-bba5-2d7ce5d2bbbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:46.930038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f429db8-1a6f-4ef7-bba5-2d7ce5d2bbbe service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:46.939181 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1116/2249] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:50:56.770264 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:56.934853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=22 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:59.066783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76724354-4d32-418a-b621-e977896595f5 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:50:59.068325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-76724354-4d32-418a-b621-e977896595f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:59.130186 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76724354-4d32-418a-b621-e977896595f5 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:50:59.134022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:50:59.134624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:50:59.134894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:50:59.135197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:50:59.137316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:50:59.204345 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:50:59.205782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:50:59.215505 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1134/2250] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:02.637889 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f429db8-1a6f-4ef7-bba5-2d7ce5d2bbbe service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:02.653192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f429db8-1a6f-4ef7-bba5-2d7ce5d2bbbe service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:02.657827 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:02.658462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:02.658735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:02.659110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] PATH_INFO: `/v3/users/b03b827eba4e43f8bf5fd2f386bb84d9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:02.660711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03b827eba4e43f8bf5fd2f386bb84d9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:02.662643 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:02.675886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:02.677571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:02.690729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c8612-a7dd-46a9-b85e-d4ea3da2afdc service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:02.696297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:02.696940 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:02.697207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:02.697511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] PATH_INFO: `/v3/users/6414c4b3a3ca4d4bab67712790abff00` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:02.698988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6414c4b3a3ca4d4bab67712790abff00)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:02.701326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:02.714289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03b827eba4e43f8bf5fd2f386bb84d9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.714986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03b827eba4e43f8bf5fd2f386bb84d9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.725688 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03b827eba4e43f8bf5fd2f386bb84d9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.738566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03b827eba4e43f8bf5fd2f386bb84d9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.739288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c510c558-2e09-4302-899a-4883fab92eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03b827eba4e43f8bf5fd2f386bb84d9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.750851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6414c4b3a3ca4d4bab67712790abff00'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.751905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6414c4b3a3ca4d4bab67712790abff00'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.754175 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1117/2251] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:02 2022] DELETE /identity/v3/users/b03b827eba4e43f8bf5fd2f386bb84d9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:02.758246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc71ec-5f90-48df-9933-ce538686424b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:02.758542 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc71ec-5f90-48df-9933-ce538686424b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:02.758787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc71ec-5f90-48df-9933-ce538686424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:02.759971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6414c4b3a3ca4d4bab67712790abff00'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.772235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6414c4b3a3ca4d4bab67712790abff00'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.772966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6414c4b3a3ca4d4bab67712790abff00'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:02.778430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-38bc71ec-5f90-48df-9933-ce538686424b None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:02.779919 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-38bc71ec-5f90-48df-9933-ce538686424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:02.795857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1135/2252] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:02 2022] DELETE /identity/v3/users/6414c4b3a3ca4d4bab67712790abff00 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:02.854512 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1118/2253] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:02.865204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:02.866678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:02.899819 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:02.942265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28802ea-91b8-48f0-aaca-5b835f6789a0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:02.945968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff280f3-0216-4a3f-9617-62dfcdd6c032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:02.946607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff280f3-0216-4a3f-9617-62dfcdd6c032 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:02.946880 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff280f3-0216-4a3f-9617-62dfcdd6c032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:02.947180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff280f3-0216-4a3f-9617-62dfcdd6c032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:02.982801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc71ec-5f90-48df-9933-ce538686424b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:02.984457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-38bc71ec-5f90-48df-9933-ce538686424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:02.998136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc71ec-5f90-48df-9933-ce538686424b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.024648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff280f3-0216-4a3f-9617-62dfcdd6c032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.026658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff280f3-0216-4a3f-9617-62dfcdd6c032 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.049925 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1136/2254] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:03.078161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.079452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.079879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.080377 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] PATH_INFO: `/v3/projects/7416718ac3cb4301b07764d92ff0d88c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.082405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7416718ac3cb4301b07764d92ff0d88c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.084479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.111308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:03.155146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7416718ac3cb4301b07764d92ff0d88c', 'request_id': 'req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.159463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7416718ac3cb4301b07764d92ff0d88c', 'request_id': 'req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.165800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7416718ac3cb4301b07764d92ff0d88c', 'request_id': 'req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.179007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] The token cache is being invalidate because project 7416718ac3cb4301b07764d92ff0d88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:03.179289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.180370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4305bd2b-eff5-4c77-9ed9-5c5871c099a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.182273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1119/2255] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:02 2022] DELETE /identity/v3/projects/7416718ac3cb4301b07764d92ff0d88c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:03.188180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c77c5-9dc7-4e15-b5b0-fe98144297b5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.188476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c77c5-9dc7-4e15-b5b0-fe98144297b5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.188747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c77c5-9dc7-4e15-b5b0-fe98144297b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.209642 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0f8c77c5-9dc7-4e15-b5b0-fe98144297b5 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:03.210998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0f8c77c5-9dc7-4e15-b5b0-fe98144297b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:03.278852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1137/2256] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:03.287653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4159-c090-4fe8-8702-d064746c3c34 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.287653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4159-c090-4fe8-8702-d064746c3c34 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.287653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4159-c090-4fe8-8702-d064746c3c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.311052 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-149b4159-c090-4fe8-8702-d064746c3c34 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:03.312331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-149b4159-c090-4fe8-8702-d064746c3c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:03.322212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1120/2257] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:03.326728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c77c5-9dc7-4e15-b5b0-fe98144297b5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.337972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c77c5-9dc7-4e15-b5b0-fe98144297b5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.344470 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94166cf9-3e30-4ec6-b57d-2ab6b35c8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.345301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94166cf9-3e30-4ec6-b57d-2ab6b35c8e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.345574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94166cf9-3e30-4ec6-b57d-2ab6b35c8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.345909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94166cf9-3e30-4ec6-b57d-2ab6b35c8e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.347283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94166cf9-3e30-4ec6-b57d-2ab6b35c8e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:03.347744 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94166cf9-3e30-4ec6-b57d-2ab6b35c8e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.348626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4159-c090-4fe8-8702-d064746c3c34 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.350103 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-149b4159-c090-4fe8-8702-d064746c3c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:03.350226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94166cf9-3e30-4ec6-b57d-2ab6b35c8e01 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.361953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4159-c090-4fe8-8702-d064746c3c34 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.367123 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.367753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.368027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.368293 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] PATH_INFO: `/v3/projects/7c419d6387c14f6da5fa8ec165934654` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.369419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c419d6387c14f6da5fa8ec165934654)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.370808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1138/2258] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:03.374735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.375258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94166cf9-3e30-4ec6-b57d-2ab6b35c8e01 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.388329 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94166cf9-3e30-4ec6-b57d-2ab6b35c8e01 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.393678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f09e35-8da2-4c97-935c-4bf57cdbd40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.394296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f09e35-8da2-4c97-935c-4bf57cdbd40a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.394498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f09e35-8da2-4c97-935c-4bf57cdbd40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.394766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f09e35-8da2-4c97-935c-4bf57cdbd40a admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.395844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f09e35-8da2-4c97-935c-4bf57cdbd40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.397766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f09e35-8da2-4c97-935c-4bf57cdbd40a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.435149 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1139/2259] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:03 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:03.436334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f09e35-8da2-4c97-935c-4bf57cdbd40a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.443221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c419d6387c14f6da5fa8ec165934654', 'request_id': 'req-9ff57b86-6386-4477-9caa-120c9b209962'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.449738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c419d6387c14f6da5fa8ec165934654', 'request_id': 'req-9ff57b86-6386-4477-9caa-120c9b209962'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.456446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c419d6387c14f6da5fa8ec165934654', 'request_id': 'req-9ff57b86-6386-4477-9caa-120c9b209962'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.470122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] The token cache is being invalidate because project 7c419d6387c14f6da5fa8ec165934654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:03.470401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.471065 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.472855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1121/2260] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:03 2022] DELETE /identity/v3/projects/7c419d6387c14f6da5fa8ec165934654 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:03.476730 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.478084 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:03.478552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:03.500468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f09e35-8da2-4c97-935c-4bf57cdbd40a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.505731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3506a9-f94a-41f2-8cd6-a9b338b3aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.506341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3506a9-f94a-41f2-8cd6-a9b338b3aa1a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.506613 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3506a9-f94a-41f2-8cd6-a9b338b3aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.506881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3506a9-f94a-41f2-8cd6-a9b338b3aa1a admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.507537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3506a9-f94a-41f2-8cd6-a9b338b3aa1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.509548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3506a9-f94a-41f2-8cd6-a9b338b3aa1a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.532968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1140/2261] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:03 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:03.537182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3506a9-f94a-41f2-8cd6-a9b338b3aa1a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.538954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2d3506a9-f94a-41f2-8cd6-a9b338b3aa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:03.545353 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff57b86-6386-4477-9caa-120c9b209962 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.550222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.550874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3506a9-f94a-41f2-8cd6-a9b338b3aa1a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.551054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.551394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.551726 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] PATH_INFO: `/v3/users/125dc0871e1e4ae0b9c8b1517a24b8ea` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.552883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125dc0871e1e4ae0b9c8b1517a24b8ea)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.554778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.555495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d719efe-2bbb-42af-898e-7fcaf4e3661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.556078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d719efe-2bbb-42af-898e-7fcaf4e3661a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.556522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d719efe-2bbb-42af-898e-7fcaf4e3661a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.556787 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d719efe-2bbb-42af-898e-7fcaf4e3661a admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.557767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d719efe-2bbb-42af-898e-7fcaf4e3661a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.559529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d719efe-2bbb-42af-898e-7fcaf4e3661a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.569723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1141/2262] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:03.573624 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d719efe-2bbb-42af-898e-7fcaf4e3661a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.578128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:03.584075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d719efe-2bbb-42af-898e-7fcaf4e3661a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.589309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3129ec-8691-4d87-919d-05e5c33f2a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.589904 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3129ec-8691-4d87-919d-05e5c33f2a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.590185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3129ec-8691-4d87-919d-05e5c33f2a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.590450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3129ec-8691-4d87-919d-05e5c33f2a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.591120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3129ec-8691-4d87-919d-05e5c33f2a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.592754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3129ec-8691-4d87-919d-05e5c33f2a7b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.604544 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1142/2263] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:03.607334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125dc0871e1e4ae0b9c8b1517a24b8ea'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.608108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125dc0871e1e4ae0b9c8b1517a24b8ea'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.608824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3129ec-8691-4d87-919d-05e5c33f2a7b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.610546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7b3129ec-8691-4d87-919d-05e5c33f2a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:03.615492 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125dc0871e1e4ae0b9c8b1517a24b8ea'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.623698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3129ec-8691-4d87-919d-05e5c33f2a7b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.628668 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125dc0871e1e4ae0b9c8b1517a24b8ea'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.629365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2d33b-19ca-4178-8111-effb2b17d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.629538 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-07dde775-3276-4fa3-966d-6a9f5f6829b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125dc0871e1e4ae0b9c8b1517a24b8ea'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:03.630130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2d33b-19ca-4178-8111-effb2b17d3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.630408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2d33b-19ca-4178-8111-effb2b17d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.630675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2d33b-19ca-4178-8111-effb2b17d3f6 admin admin] PATH_INFO: `/v3/projects/f373c389531d421b91c03eaed578f38c/users/e34c3b735cf6400e9988180b46f77abb/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.644022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1122/2264] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:03 2022] DELETE /identity/v3/users/125dc0871e1e4ae0b9c8b1517a24b8ea => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:03.648980 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2d33b-19ca-4178-8111-effb2b17d3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f373c389531d421b91c03eaed578f38c, user_id=e34c3b735cf6400e9988180b46f77abb, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.651683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2d33b-19ca-4178-8111-effb2b17d3f6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.673741 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1143/2265] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:03 2022] PUT /identity/v3/projects/f373c389531d421b91c03eaed578f38c/users/e34c3b735cf6400e9988180b46f77abb/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:03.684537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa1292-dd64-4bef-8730-0de1ef74d73e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.684821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa1292-dd64-4bef-8730-0de1ef74d73e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.685089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa1292-dd64-4bef-8730-0de1ef74d73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.714594 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-72aa1292-dd64-4bef-8730-0de1ef74d73e None None] MFA Rules not processed for user `e34c3b735cf6400e9988180b46f77abb`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:03.715822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-72aa1292-dd64-4bef-8730-0de1ef74d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:03.787684 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1123/2266] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:03.789228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2d33b-19ca-4178-8111-effb2b17d3f6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.854599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2d33b-19ca-4178-8111-effb2b17d3f6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.859292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9648d38-a2ff-4ca2-b4ec-2ee37e831471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.859900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648d38-a2ff-4ca2-b4ec-2ee37e831471 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.860178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648d38-a2ff-4ca2-b4ec-2ee37e831471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.860447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648d38-a2ff-4ca2-b4ec-2ee37e831471 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.861075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9648d38-a2ff-4ca2-b4ec-2ee37e831471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.863250 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9648d38-a2ff-4ca2-b4ec-2ee37e831471 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:03.893954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1144/2267] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:03 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:03.898588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa1292-dd64-4bef-8730-0de1ef74d73e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.909981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa1292-dd64-4bef-8730-0de1ef74d73e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:03.925784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9648d38-a2ff-4ca2-b4ec-2ee37e831471 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:03.928510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c9648d38-a2ff-4ca2-b4ec-2ee37e831471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:03.986402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04524c-570c-4659-a45f-6e62c4afbd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:03.987221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04524c-570c-4659-a45f-6e62c4afbd47 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:03.987517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04524c-570c-4659-a45f-6e62c4afbd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:03.987966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04524c-570c-4659-a45f-6e62c4afbd47 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:03.988645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04524c-570c-4659-a45f-6e62c4afbd47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:03.990850 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04524c-570c-4659-a45f-6e62c4afbd47 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.003065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9648d38-a2ff-4ca2-b4ec-2ee37e831471 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.007867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.008500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.008773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.009043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] PATH_INFO: `/v3/projects/45922243b7fc4db9a792d43b4db74de0` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.010151 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] RBAC: Authorizing `identity:delete_project(project_id=45922243b7fc4db9a792d43b4db74de0)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.012129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.017917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1124/2268] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:03 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:04.019239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04524c-570c-4659-a45f-6e62c4afbd47 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.020784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:04.030284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04524c-570c-4659-a45f-6e62c4afbd47 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.035008 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878152e-e66d-4d05-bd47-95836798994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.035609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878152e-e66d-4d05-bd47-95836798994b admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.035880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878152e-e66d-4d05-bd47-95836798994b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.036144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878152e-e66d-4d05-bd47-95836798994b admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.036777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878152e-e66d-4d05-bd47-95836798994b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.038354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878152e-e66d-4d05-bd47-95836798994b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.048664 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1125/2269] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:04.052869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878152e-e66d-4d05-bd47-95836798994b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.063677 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878152e-e66d-4d05-bd47-95836798994b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.065962 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45922243b7fc4db9a792d43b4db74de0', 'request_id': 'req-ca14ad99-93d6-4554-ae9c-c8acf56d625d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:04.068382 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:04.074208 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45922243b7fc4db9a792d43b4db74de0', 'request_id': 'req-ca14ad99-93d6-4554-ae9c-c8acf56d625d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:04.081686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45922243b7fc4db9a792d43b4db74de0', 'request_id': 'req-ca14ad99-93d6-4554-ae9c-c8acf56d625d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:04.095715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] The token cache is being invalidate because project 45922243b7fc4db9a792d43b4db74de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:04.095998 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:04.096713 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca14ad99-93d6-4554-ae9c-c8acf56d625d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:04.098469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1145/2270] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:03 2022] DELETE /identity/v3/projects/45922243b7fc4db9a792d43b4db74de0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:04.102974 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36c5a0-7368-4b50-babb-6e36ddd5bfdb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.103321 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36c5a0-7368-4b50-babb-6e36ddd5bfdb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.103591 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36c5a0-7368-4b50-babb-6e36ddd5bfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.124282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4c36c5a0-7368-4b50-babb-6e36ddd5bfdb None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:04.125044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a6088-4876-4353-baba-a0bd898b5fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.125660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4c36c5a0-7368-4b50-babb-6e36ddd5bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:04.125792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a6088-4876-4353-baba-a0bd898b5fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.125984 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a6088-4876-4353-baba-a0bd898b5fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.126257 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a6088-4876-4353-baba-a0bd898b5fe6 admin admin] PATH_INFO: `/v3/projects/078e8641a0cf4aac8918126fd228f6d3/users/15ca43d2ea1045179e56f43faee45e11/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.134858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1146/2271] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:04.141667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a6088-4876-4353-baba-a0bd898b5fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078e8641a0cf4aac8918126fd228f6d3, user_id=15ca43d2ea1045179e56f43faee45e11, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.143983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9be238-ba95-4581-8a2f-f6b532efe280 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.144256 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9be238-ba95-4581-8a2f-f6b532efe280 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.144522 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9be238-ba95-4581-8a2f-f6b532efe280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.144626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a6088-4876-4353-baba-a0bd898b5fe6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.159973 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1126/2272] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:04 2022] PUT /identity/v3/projects/078e8641a0cf4aac8918126fd228f6d3/users/15ca43d2ea1045179e56f43faee45e11/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:04.163928 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a6088-4876-4353-baba-a0bd898b5fe6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.164537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ce9be238-ba95-4581-8a2f-f6b532efe280 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:04.165550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cc2a6088-4876-4353-baba-a0bd898b5fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:04.165804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ce9be238-ba95-4581-8a2f-f6b532efe280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:04.238129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1147/2273] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:04.238308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a6088-4876-4353-baba-a0bd898b5fe6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.239831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9be238-ba95-4581-8a2f-f6b532efe280 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.242544 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb5796-e358-443a-84bc-15be04797f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.243184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb5796-e358-443a-84bc-15be04797f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.243459 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb5796-e358-443a-84bc-15be04797f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.243726 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb5796-e358-443a-84bc-15be04797f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.244367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb5796-e358-443a-84bc-15be04797f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.245962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb5796-e358-443a-84bc-15be04797f42 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.249071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9be238-ba95-4581-8a2f-f6b532efe280 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.254277 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdcda9-f566-4754-beeb-18050eb15f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.254910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdcda9-f566-4754-beeb-18050eb15f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.255233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdcda9-f566-4754-beeb-18050eb15f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.255483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdcda9-f566-4754-beeb-18050eb15f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.256123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdcda9-f566-4754-beeb-18050eb15f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:04.256421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdcda9-f566-4754-beeb-18050eb15f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.256727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1127/2274] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:04.258133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdcda9-f566-4754-beeb-18050eb15f1d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.260882 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb5796-e358-443a-84bc-15be04797f42 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.270527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1148/2275] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:51:04.270745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb5796-e358-443a-84bc-15be04797f42 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.275022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdcda9-f566-4754-beeb-18050eb15f1d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.275387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9433f-c025-45b1-b1f3-5b5acf2163b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.276031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9433f-c025-45b1-b1f3-5b5acf2163b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.276309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9433f-c025-45b1-b1f3-5b5acf2163b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.276597 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9433f-c025-45b1-b1f3-5b5acf2163b2 admin admin] PATH_INFO: `/v3/projects/078e8641a0cf4aac8918126fd228f6d3/users/15ca43d2ea1045179e56f43faee45e11/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.278943 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9433f-c025-45b1-b1f3-5b5acf2163b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078e8641a0cf4aac8918126fd228f6d3, user_id=15ca43d2ea1045179e56f43faee45e11, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.281622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9433f-c025-45b1-b1f3-5b5acf2163b2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.286782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdcda9-f566-4754-beeb-18050eb15f1d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.296442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1128/2276] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:04 2022] PUT /identity/v3/projects/078e8641a0cf4aac8918126fd228f6d3/users/15ca43d2ea1045179e56f43faee45e11/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:04.308507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59cbf-04af-4488-89eb-c63a5566a1f9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.308857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59cbf-04af-4488-89eb-c63a5566a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.309137 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59cbf-04af-4488-89eb-c63a5566a1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.340703 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e2e59cbf-04af-4488-89eb-c63a5566a1f9 None None] MFA Rules not processed for user `15ca43d2ea1045179e56f43faee45e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:04.342003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e2e59cbf-04af-4488-89eb-c63a5566a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:04.354648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680ff7-b174-4ae3-8edd-73dd7fe5ed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.355600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680ff7-b174-4ae3-8edd-73dd7fe5ed03 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.356007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680ff7-b174-4ae3-8edd-73dd7fe5ed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.356307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680ff7-b174-4ae3-8edd-73dd7fe5ed03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.356981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680ff7-b174-4ae3-8edd-73dd7fe5ed03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.358912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680ff7-b174-4ae3-8edd-73dd7fe5ed03 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.393703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1149/2277] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:04 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:04.397946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680ff7-b174-4ae3-8edd-73dd7fe5ed03 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.402274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:04.414620 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:04.424165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1129/2278] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:04.432224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e59cbf-04af-4488-89eb-c63a5566a1f9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.433792 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e2e59cbf-04af-4488-89eb-c63a5566a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:04.462981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680ff7-b174-4ae3-8edd-73dd7fe5ed03 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.467708 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904041f-d6f2-453c-b411-f3c14d2eb55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.468312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904041f-d6f2-453c-b411-f3c14d2eb55c admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.468586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904041f-d6f2-453c-b411-f3c14d2eb55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.468875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904041f-d6f2-453c-b411-f3c14d2eb55c admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.469498 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904041f-d6f2-453c-b411-f3c14d2eb55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.471490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904041f-d6f2-453c-b411-f3c14d2eb55c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.491960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e59cbf-04af-4488-89eb-c63a5566a1f9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.495316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1150/2279] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:04 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:04.499434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904041f-d6f2-453c-b411-f3c14d2eb55c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.509548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904041f-d6f2-453c-b411-f3c14d2eb55c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.514363 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e23e4-2a50-4f00-8e96-dce5ceae07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.514988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e23e4-2a50-4f00-8e96-dce5ceae07cf admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.515337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e23e4-2a50-4f00-8e96-dce5ceae07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.515613 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e23e4-2a50-4f00-8e96-dce5ceae07cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.516249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e23e4-2a50-4f00-8e96-dce5ceae07cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.517862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e23e4-2a50-4f00-8e96-dce5ceae07cf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.528382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1151/2280] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:04.532640 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e23e4-2a50-4f00-8e96-dce5ceae07cf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.542543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e23e4-2a50-4f00-8e96-dce5ceae07cf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.547224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace89285-b633-4b99-b90e-a1246a0a35c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.547386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2a50c-ae7b-4bad-83ac-39b3d9e99aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.547896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a50c-ae7b-4bad-83ac-39b3d9e99aed admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.548172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a50c-ae7b-4bad-83ac-39b3d9e99aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.548288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace89285-b633-4b99-b90e-a1246a0a35c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.548440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a50c-ae7b-4bad-83ac-39b3d9e99aed admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.548543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace89285-b633-4b99-b90e-a1246a0a35c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.548774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace89285-b633-4b99-b90e-a1246a0a35c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.549069 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2a50c-ae7b-4bad-83ac-39b3d9e99aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.550719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2a50c-ae7b-4bad-83ac-39b3d9e99aed admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.561780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1152/2281] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:04.566190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2a50c-ae7b-4bad-83ac-39b3d9e99aed admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.576185 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2a50c-ae7b-4bad-83ac-39b3d9e99aed admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.581577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385b06d-9b96-46e3-b72a-f4b8ffafb4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.582227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385b06d-9b96-46e3-b72a-f4b8ffafb4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.582507 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385b06d-9b96-46e3-b72a-f4b8ffafb4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.582782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385b06d-9b96-46e3-b72a-f4b8ffafb4cd admin admin] PATH_INFO: `/v3/projects/6b54df391ba24e4abf6e52ea6a417723/users/4038f9b018644faab9afe617d5eecc50/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.597771 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385b06d-9b96-46e3-b72a-f4b8ffafb4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b54df391ba24e4abf6e52ea6a417723, user_id=4038f9b018644faab9afe617d5eecc50, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.600465 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385b06d-9b96-46e3-b72a-f4b8ffafb4cd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.609230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace89285-b633-4b99-b90e-a1246a0a35c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.611244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace89285-b633-4b99-b90e-a1246a0a35c7 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.617539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1153/2282] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:04 2022] PUT /identity/v3/projects/6b54df391ba24e4abf6e52ea6a417723/users/4038f9b018644faab9afe617d5eecc50/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:04.625756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839bbaa-597b-463d-8fb6-1c28987187ce None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.626058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839bbaa-597b-463d-8fb6-1c28987187ce None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.626814 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839bbaa-597b-463d-8fb6-1c28987187ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.631341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1130/2283] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:51:04.654861 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6839bbaa-597b-463d-8fb6-1c28987187ce None None] MFA Rules not processed for user `4038f9b018644faab9afe617d5eecc50`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:04.656153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6839bbaa-597b-463d-8fb6-1c28987187ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:04.729679 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1154/2284] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:04.730483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace89285-b633-4b99-b90e-a1246a0a35c7 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.742542 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace89285-b633-4b99-b90e-a1246a0a35c7 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.800903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6ac4-eeec-42d6-b758-4ae718c218f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.801418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6ac4-eeec-42d6-b758-4ae718c218f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.801720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6ac4-eeec-42d6-b758-4ae718c218f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.801976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6ac4-eeec-42d6-b758-4ae718c218f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.802613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b6ac4-eeec-42d6-b758-4ae718c218f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.804692 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b6ac4-eeec-42d6-b758-4ae718c218f4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.814608 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:04.835591 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1131/2285] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:04 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:04.839597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839bbaa-597b-463d-8fb6-1c28987187ce None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.850282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839bbaa-597b-463d-8fb6-1c28987187ce None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.885014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:04.913669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8479a36-633c-4dd1-aea0-87f12fd63188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.914291 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8479a36-633c-4dd1-aea0-87f12fd63188 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.914566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8479a36-633c-4dd1-aea0-87f12fd63188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.914833 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8479a36-633c-4dd1-aea0-87f12fd63188 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.915502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8479a36-633c-4dd1-aea0-87f12fd63188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.917538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8479a36-633c-4dd1-aea0-87f12fd63188 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.939753 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1155/2286] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:04 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:04.943920 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6ac4-eeec-42d6-b758-4ae718c218f4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.955140 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6ac4-eeec-42d6-b758-4ae718c218f4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.960787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c0ead-af24-4e90-b465-7673148f9d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.961387 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c0ead-af24-4e90-b465-7673148f9d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.961805 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c0ead-af24-4e90-b465-7673148f9d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.962076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c0ead-af24-4e90-b465-7673148f9d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:04.962715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c0ead-af24-4e90-b465-7673148f9d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:04.964356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c0ead-af24-4e90-b465-7673148f9d96 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:04.976002 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1132/2287] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:04.979913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8479a36-633c-4dd1-aea0-87f12fd63188 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:04.991232 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8479a36-633c-4dd1-aea0-87f12fd63188 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:04.996681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e9f2-3551-4254-a93f-82df12acbaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:04.997292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e9f2-3551-4254-a93f-82df12acbaac admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:04.997570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e9f2-3551-4254-a93f-82df12acbaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:04.997840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e9f2-3551-4254-a93f-82df12acbaac admin admin] PATH_INFO: `/v3/projects/9cc301ae620945eeb54e152db225f83b/users/f93f05ec34814ed1b3cce14bcb5e1121/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.013917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e9f2-3551-4254-a93f-82df12acbaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc301ae620945eeb54e152db225f83b, user_id=f93f05ec34814ed1b3cce14bcb5e1121, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:05.020658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e9f2-3551-4254-a93f-82df12acbaac admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:05.033147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1156/2288] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:04 2022] PUT /identity/v3/projects/9cc301ae620945eeb54e152db225f83b/users/f93f05ec34814ed1b3cce14bcb5e1121/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:05.037196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c0ead-af24-4e90-b465-7673148f9d96 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:05.050852 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c0ead-af24-4e90-b465-7673148f9d96 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:05.111472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf507b-6c65-4e36-9a3f-7f9cd54f0eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:05.112098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf507b-6c65-4e36-9a3f-7f9cd54f0eec admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:05.112363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf507b-6c65-4e36-9a3f-7f9cd54f0eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:05.112625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf507b-6c65-4e36-9a3f-7f9cd54f0eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.113264 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf507b-6c65-4e36-9a3f-7f9cd54f0eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:05.115066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf507b-6c65-4e36-9a3f-7f9cd54f0eec admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:05.125472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1133/2289] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:05.130489 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e9f2-3551-4254-a93f-82df12acbaac admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:05.141164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e9f2-3551-4254-a93f-82df12acbaac admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:05.146298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ac7-934b-47ba-9f0a-ceb13b298da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:05.147003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ac7-934b-47ba-9f0a-ceb13b298da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:05.147284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ac7-934b-47ba-9f0a-ceb13b298da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:05.147550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ac7-934b-47ba-9f0a-ceb13b298da5 admin admin] PATH_INFO: `/v3/projects/9cc301ae620945eeb54e152db225f83b/users/f93f05ec34814ed1b3cce14bcb5e1121/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.149491 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8ac7-934b-47ba-9f0a-ceb13b298da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc301ae620945eeb54e152db225f83b, user_id=f93f05ec34814ed1b3cce14bcb5e1121, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:05.152196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8ac7-934b-47ba-9f0a-ceb13b298da5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:05.162894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1157/2290] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:05 2022] PUT /identity/v3/projects/9cc301ae620945eeb54e152db225f83b/users/f93f05ec34814ed1b3cce14bcb5e1121/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:05.173428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aff88-54f0-43c0-a10c-ebcd64343b9e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:05.173713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aff88-54f0-43c0-a10c-ebcd64343b9e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:05.173988 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aff88-54f0-43c0-a10c-ebcd64343b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.203566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1d2aff88-54f0-43c0-a10c-ebcd64343b9e None None] MFA Rules not processed for user `f93f05ec34814ed1b3cce14bcb5e1121`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:05.204789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1d2aff88-54f0-43c0-a10c-ebcd64343b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:05.212271 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ac7-934b-47ba-9f0a-ceb13b298da5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:05.276251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1134/2291] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:05.277180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ac7-934b-47ba-9f0a-ceb13b298da5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:05.281978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:05.282465 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:05.282743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:05.283042 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] PATH_INFO: `/v3/users/e34c3b735cf6400e9988180b46f77abb` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.284230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34c3b735cf6400e9988180b46f77abb)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:05.286159 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:05.288026 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aff88-54f0-43c0-a10c-ebcd64343b9e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:05.339046 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34c3b735cf6400e9988180b46f77abb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:05.339714 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34c3b735cf6400e9988180b46f77abb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:05.346066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aff88-54f0-43c0-a10c-ebcd64343b9e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:05.347398 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34c3b735cf6400e9988180b46f77abb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:05.350272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1707c-ad41-4efd-a255-17ba16e51d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:05.350881 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1707c-ad41-4efd-a255-17ba16e51d30 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:05.351187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1707c-ad41-4efd-a255-17ba16e51d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:05.351455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1707c-ad41-4efd-a255-17ba16e51d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.353241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-11e1707c-ad41-4efd-a255-17ba16e51d30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:05.366070 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34c3b735cf6400e9988180b46f77abb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:05.366375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1707c-ad41-4efd-a255-17ba16e51d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:05.366912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34c3b735cf6400e9988180b46f77abb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:05.367858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1707c-ad41-4efd-a255-17ba16e51d30 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:05.382917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1135/2292] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:51:05.392914 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1158/2293] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:05 2022] DELETE /identity/v3/users/e34c3b735cf6400e9988180b46f77abb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:05.398075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663d818-6d71-44e0-92e7-3852c5addd1e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:05.398363 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663d818-6d71-44e0-92e7-3852c5addd1e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:05.398653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663d818-6d71-44e0-92e7-3852c5addd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.406894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:05.423585 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6663d818-6d71-44e0-92e7-3852c5addd1e None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:05.425110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6663d818-6d71-44e0-92e7-3852c5addd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:05.484509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:05.486097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:05.496808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:05.499513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1136/2294] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:05.511750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663d818-6d71-44e0-92e7-3852c5addd1e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:05.513393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6663d818-6d71-44e0-92e7-3852c5addd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:05.550226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb51bb6-0503-4395-ae44-a1a1bf130d29 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:05.553964 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387ff06-5b06-447f-93b3-bf51b53b68e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:05.554610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387ff06-5b06-447f-93b3-bf51b53b68e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:05.554893 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387ff06-5b06-447f-93b3-bf51b53b68e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:05.555199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387ff06-5b06-447f-93b3-bf51b53b68e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.557114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e387ff06-5b06-447f-93b3-bf51b53b68e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:05.577860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663d818-6d71-44e0-92e7-3852c5addd1e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:05.582283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dbfab-dbf9-42a2-8c01-062e5df8725b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:05.582892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dbfab-dbf9-42a2-8c01-062e5df8725b service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:05.583228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dbfab-dbf9-42a2-8c01-062e5df8725b service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:05.583500 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dbfab-dbf9-42a2-8c01-062e5df8725b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.593803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dbfab-dbf9-42a2-8c01-062e5df8725b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:05.595331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dbfab-dbf9-42a2-8c01-062e5df8725b service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:05.605068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1137/2295] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:51:05.619163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387ff06-5b06-447f-93b3-bf51b53b68e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:05.620797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387ff06-5b06-447f-93b3-bf51b53b68e3 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:05.631617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1159/2296] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:05.897421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dbfab-dbf9-42a2-8c01-062e5df8725b service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:05.898941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ba8dbfab-dbf9-42a2-8c01-062e5df8725b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:05.917735 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dbfab-dbf9-42a2-8c01-062e5df8725b service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:05.925691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:05.926433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:05.926797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:05.927125 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] PATH_INFO: `/v3/projects/f373c389531d421b91c03eaed578f38c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:05.928343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f373c389531d421b91c03eaed578f38c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:05.930300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:05.981551 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f373c389531d421b91c03eaed578f38c', 'request_id': 'req-9cd854d8-2104-4edf-a56a-9ef790062d3a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:05.988592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f373c389531d421b91c03eaed578f38c', 'request_id': 'req-9cd854d8-2104-4edf-a56a-9ef790062d3a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:05.994803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f373c389531d421b91c03eaed578f38c', 'request_id': 'req-9cd854d8-2104-4edf-a56a-9ef790062d3a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.008982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] The token cache is being invalidate because project f373c389531d421b91c03eaed578f38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:06.009281 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.009890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.011462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1138/2297] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:05 2022] DELETE /identity/v3/projects/f373c389531d421b91c03eaed578f38c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:06.015536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387ff06-5b06-447f-93b3-bf51b53b68e3 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:06.026884 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387ff06-5b06-447f-93b3-bf51b53b68e3 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:06.086017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:06.086562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:06.086826 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:06.087120 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] PATH_INFO: `/v3/users/15ca43d2ea1045179e56f43faee45e11` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:06.088305 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ca43d2ea1045179e56f43faee45e11)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:06.090234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:06.138793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ca43d2ea1045179e56f43faee45e11'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.139750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ca43d2ea1045179e56f43faee45e11'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.150442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ca43d2ea1045179e56f43faee45e11'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.156018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:06.169559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ca43d2ea1045179e56f43faee45e11'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.170514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-f8146392-293b-4ed6-bf64-a95656aed7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ca43d2ea1045179e56f43faee45e11'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.186623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1160/2298] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:06 2022] DELETE /identity/v3/users/15ca43d2ea1045179e56f43faee45e11 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:06.471533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:06.473271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:06.490611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd854d8-2104-4edf-a56a-9ef790062d3a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:06.521322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:06.557255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:06.557893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:06.558170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:06.558439 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] PATH_INFO: `/v3/projects/078e8641a0cf4aac8918126fd228f6d3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:06.559568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] RBAC: Authorizing `identity:delete_project(project_id=078e8641a0cf4aac8918126fd228f6d3)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:06.561478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:06.613329 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078e8641a0cf4aac8918126fd228f6d3', 'request_id': 'req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.619771 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078e8641a0cf4aac8918126fd228f6d3', 'request_id': 'req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.625944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078e8641a0cf4aac8918126fd228f6d3', 'request_id': 'req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.640402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] The token cache is being invalidate because project 078e8641a0cf4aac8918126fd228f6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:06.640642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.641253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3e433bcc-7dcf-41c5-8e6e-58e4592e368c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:06.642745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1139/2299] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:06 2022] DELETE /identity/v3/projects/078e8641a0cf4aac8918126fd228f6d3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:06.647924 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83cb9-ff74-4532-919c-cce7b869dea3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:06.648199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83cb9-ff74-4532-919c-cce7b869dea3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:06.648467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83cb9-ff74-4532-919c-cce7b869dea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:06.669050 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-dab83cb9-ff74-4532-919c-cce7b869dea3 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:06.670253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-dab83cb9-ff74-4532-919c-cce7b869dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:06.738827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1161/2300] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:06.747011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964bb97-a3d6-46ce-bee0-182e97e772d7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:06.747365 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964bb97-a3d6-46ce-bee0-182e97e772d7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:06.747728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964bb97-a3d6-46ce-bee0-182e97e772d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:06.769251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b964bb97-a3d6-46ce-bee0-182e97e772d7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:06.770456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b964bb97-a3d6-46ce-bee0-182e97e772d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:06.778442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1140/2301] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:06.784501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab83cb9-ff74-4532-919c-cce7b869dea3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:06.794303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab83cb9-ff74-4532-919c-cce7b869dea3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:06.799674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4ca23-70da-4e8b-9c5b-0f199b15222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:06.800340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4ca23-70da-4e8b-9c5b-0f199b15222e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:06.800616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4ca23-70da-4e8b-9c5b-0f199b15222e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:06.800882 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4ca23-70da-4e8b-9c5b-0f199b15222e admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:06.801525 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4ca23-70da-4e8b-9c5b-0f199b15222e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:06.801823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4ca23-70da-4e8b-9c5b-0f199b15222e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:06.803450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4ca23-70da-4e8b-9c5b-0f199b15222e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:06.820360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1162/2302] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:06.824201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964bb97-a3d6-46ce-bee0-182e97e772d7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:06.834503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964bb97-a3d6-46ce-bee0-182e97e772d7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:06.839389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ec158-3716-43ea-9aec-991ebb340e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:06.839926 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec158-3716-43ea-9aec-991ebb340e2e admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:06.840204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec158-3716-43ea-9aec-991ebb340e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:06.840484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec158-3716-43ea-9aec-991ebb340e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:06.841121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ec158-3716-43ea-9aec-991ebb340e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:06.843056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ec158-3716-43ea-9aec-991ebb340e2e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:06.879146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1141/2303] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:06 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:06.883954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4ca23-70da-4e8b-9c5b-0f199b15222e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:06.896257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4ca23-70da-4e8b-9c5b-0f199b15222e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:06.967003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583e1fc-93db-4695-bcef-179701e5687e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:06.967003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583e1fc-93db-4695-bcef-179701e5687e admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:06.967003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583e1fc-93db-4695-bcef-179701e5687e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:06.967003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583e1fc-93db-4695-bcef-179701e5687e admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:06.967418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583e1fc-93db-4695-bcef-179701e5687e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:06.967418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583e1fc-93db-4695-bcef-179701e5687e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:06.990982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1163/2304] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:06 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:06.993794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ec158-3716-43ea-9aec-991ebb340e2e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:07.005141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ec158-3716-43ea-9aec-991ebb340e2e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:07.009841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20115-d411-46ec-a66b-3a3a30f6a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:07.010452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20115-d411-46ec-a66b-3a3a30f6a1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:07.010900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20115-d411-46ec-a66b-3a3a30f6a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:07.011159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20115-d411-46ec-a66b-3a3a30f6a1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:07.011784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20115-d411-46ec-a66b-3a3a30f6a1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:07.013372 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20115-d411-46ec-a66b-3a3a30f6a1fb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:07.023932 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1142/2305] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:07.031169 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583e1fc-93db-4695-bcef-179701e5687e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:07.039173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583e1fc-93db-4695-bcef-179701e5687e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:07.044159 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264880a-1b0c-400f-9cde-7d9e892da38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:07.044830 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264880a-1b0c-400f-9cde-7d9e892da38d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:07.045181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264880a-1b0c-400f-9cde-7d9e892da38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:07.045450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264880a-1b0c-400f-9cde-7d9e892da38d admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:07.046090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264880a-1b0c-400f-9cde-7d9e892da38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:07.047966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264880a-1b0c-400f-9cde-7d9e892da38d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:07.060145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1164/2306] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:07.064448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20115-d411-46ec-a66b-3a3a30f6a1fb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:07.074408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20115-d411-46ec-a66b-3a3a30f6a1fb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:07.079126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31c7ee-4676-4dc0-aac2-cec46f2c9cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:07.079838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c7ee-4676-4dc0-aac2-cec46f2c9cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:07.080177 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c7ee-4676-4dc0-aac2-cec46f2c9cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:07.080509 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c7ee-4676-4dc0-aac2-cec46f2c9cb8 admin admin] PATH_INFO: `/v3/projects/96aaab2dbb9a4068b3fa68469d6e1a28/users/58eb33a85fc240999b83b8c7c316d9ac/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:07.100707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31c7ee-4676-4dc0-aac2-cec46f2c9cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96aaab2dbb9a4068b3fa68469d6e1a28, user_id=58eb33a85fc240999b83b8c7c316d9ac, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:07.103583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31c7ee-4676-4dc0-aac2-cec46f2c9cb8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:07.117723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1143/2307] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:07 2022] PUT /identity/v3/projects/96aaab2dbb9a4068b3fa68469d6e1a28/users/58eb33a85fc240999b83b8c7c316d9ac/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:07.128982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9435fc0-0543-4c64-b85e-3b79189732e6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:07.129235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9435fc0-0543-4c64-b85e-3b79189732e6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:07.129539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9435fc0-0543-4c64-b85e-3b79189732e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:07.158862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e9435fc0-0543-4c64-b85e-3b79189732e6 None None] MFA Rules not processed for user `58eb33a85fc240999b83b8c7c316d9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:07.160184 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e9435fc0-0543-4c64-b85e-3b79189732e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:07.197400 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:07.231619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1165/2308] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:07.243732 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31c7ee-4676-4dc0-aac2-cec46f2c9cb8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:07.245551 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1a31c7ee-4676-4dc0-aac2-cec46f2c9cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:07.304250 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31c7ee-4676-4dc0-aac2-cec46f2c9cb8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:07.307927 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51053b7-d383-464b-8681-c2751ce256de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:07.308523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51053b7-d383-464b-8681-c2751ce256de service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:07.308793 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51053b7-d383-464b-8681-c2751ce256de service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:07.309056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51053b7-d383-464b-8681-c2751ce256de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:07.317620 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51053b7-d383-464b-8681-c2751ce256de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:07.319108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51053b7-d383-464b-8681-c2751ce256de service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:07.322634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:07.328765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1144/2309] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:07.355944 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9435fc0-0543-4c64-b85e-3b79189732e6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:07.420881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9435fc0-0543-4c64-b85e-3b79189732e6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:07.426623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:07.427292 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:07.427564 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:07.427829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] PATH_INFO: `/v3/users/58eb33a85fc240999b83b8c7c316d9ac` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:07.429046 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58eb33a85fc240999b83b8c7c316d9ac)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:07.431103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:07.483286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58eb33a85fc240999b83b8c7c316d9ac'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:07.483951 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58eb33a85fc240999b83b8c7c316d9ac'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:07.491153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58eb33a85fc240999b83b8c7c316d9ac'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:07.504424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58eb33a85fc240999b83b8c7c316d9ac'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:07.505119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58eb33a85fc240999b83b8c7c316d9ac'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:07.519811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1166/2310] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:07 2022] DELETE /identity/v3/users/58eb33a85fc240999b83b8c7c316d9ac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:07.524484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28db55-163d-44c5-bb83-73e5d6d0e987 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:07.524833 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28db55-163d-44c5-bb83-73e5d6d0e987 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:07.525168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28db55-163d-44c5-bb83-73e5d6d0e987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:07.545131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4c28db55-163d-44c5-bb83-73e5d6d0e987 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:07.546518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4c28db55-163d-44c5-bb83-73e5d6d0e987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:07.609985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1145/2311] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:07.620019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:07.621629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:07.681385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0829-1d64-4483-9523-2377153fb5c7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:07.685399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76e192-fd76-4397-9532-5316456a3447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:07.685999 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76e192-fd76-4397-9532-5316456a3447 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:07.686271 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76e192-fd76-4397-9532-5316456a3447 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:07.686534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76e192-fd76-4397-9532-5316456a3447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:07.695843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76e192-fd76-4397-9532-5316456a3447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:07.697281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76e192-fd76-4397-9532-5316456a3447 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:07.701109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:07.707794 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1167/2312] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:07.999248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28db55-163d-44c5-bb83-73e5d6d0e987 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.000905 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4c28db55-163d-44c5-bb83-73e5d6d0e987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:08.016287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28db55-163d-44c5-bb83-73e5d6d0e987 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.023739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.024635 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.024912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.025166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] PATH_INFO: `/v3/projects/96aaab2dbb9a4068b3fa68469d6e1a28` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.026303 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96aaab2dbb9a4068b3fa68469d6e1a28)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.028267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.077623 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96aaab2dbb9a4068b3fa68469d6e1a28', 'request_id': 'req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.084394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96aaab2dbb9a4068b3fa68469d6e1a28', 'request_id': 'req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.089781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96aaab2dbb9a4068b3fa68469d6e1a28', 'request_id': 'req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.104540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] The token cache is being invalidate because project 96aaab2dbb9a4068b3fa68469d6e1a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:08.104824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.105447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-920cbc9a-3abf-40bf-bca2-6ae3c4b91e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.106983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1146/2313] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:07 2022] DELETE /identity/v3/projects/96aaab2dbb9a4068b3fa68469d6e1a28 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:08.111991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7091f-2105-44ec-90c8-2f1f048e8231 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.112495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7091f-2105-44ec-90c8-2f1f048e8231 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.112608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7091f-2105-44ec-90c8-2f1f048e8231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.133721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-cbe7091f-2105-44ec-90c8-2f1f048e8231 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:08.134856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cbe7091f-2105-44ec-90c8-2f1f048e8231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:08.200258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1168/2314] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:08.210452 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd23b26-eed9-4da8-bbb9-b9b22ebb6033 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.210782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd23b26-eed9-4da8-bbb9-b9b22ebb6033 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.211194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd23b26-eed9-4da8-bbb9-b9b22ebb6033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.235059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-cbd23b26-eed9-4da8-bbb9-b9b22ebb6033 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:08.236286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cbd23b26-eed9-4da8-bbb9-b9b22ebb6033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:08.245729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1147/2315] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:08.250009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7091f-2105-44ec-90c8-2f1f048e8231 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.260065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7091f-2105-44ec-90c8-2f1f048e8231 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.264889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02a88-3a65-4a1c-b961-4a6528e53601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.265481 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02a88-3a65-4a1c-b961-4a6528e53601 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.265755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02a88-3a65-4a1c-b961-4a6528e53601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.266024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02a88-3a65-4a1c-b961-4a6528e53601 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.266658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02a88-3a65-4a1c-b961-4a6528e53601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:08.266965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02a88-3a65-4a1c-b961-4a6528e53601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.268702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02a88-3a65-4a1c-b961-4a6528e53601 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.280261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1169/2316] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:08.284919 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd23b26-eed9-4da8-bbb9-b9b22ebb6033 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.295566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd23b26-eed9-4da8-bbb9-b9b22ebb6033 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.301187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96045877-8069-4c7e-883f-83da5c8f6045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.301788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96045877-8069-4c7e-883f-83da5c8f6045 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.302042 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96045877-8069-4c7e-883f-83da5c8f6045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.302440 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96045877-8069-4c7e-883f-83da5c8f6045 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.303070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96045877-8069-4c7e-883f-83da5c8f6045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.304973 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96045877-8069-4c7e-883f-83da5c8f6045 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.338727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1148/2317] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:08 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:08.339888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02a88-3a65-4a1c-b961-4a6528e53601 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.350449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02a88-3a65-4a1c-b961-4a6528e53601 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.411840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef694f-aef8-4607-8822-2ebcb43871aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.412729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef694f-aef8-4607-8822-2ebcb43871aa admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.413102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef694f-aef8-4607-8822-2ebcb43871aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.413340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef694f-aef8-4607-8822-2ebcb43871aa admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.413448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96045877-8069-4c7e-883f-83da5c8f6045 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.413964 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef694f-aef8-4607-8822-2ebcb43871aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.415807 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96045877-8069-4c7e-883f-83da5c8f6045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:08.415996 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef694f-aef8-4607-8822-2ebcb43871aa admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.429356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96045877-8069-4c7e-883f-83da5c8f6045 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.435234 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.435937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.436275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.436634 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] PATH_INFO: `/v3/users/4038f9b018644faab9afe617d5eecc50` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.437886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4038f9b018644faab9afe617d5eecc50)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.438746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1170/2318] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:08 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:08.442775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef694f-aef8-4607-8822-2ebcb43871aa admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.443161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.452578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef694f-aef8-4607-8822-2ebcb43871aa admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.457300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb924bd7-b0b5-4fb6-bf9e-db1041158e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.457889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb924bd7-b0b5-4fb6-bf9e-db1041158e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.458161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb924bd7-b0b5-4fb6-bf9e-db1041158e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.458432 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb924bd7-b0b5-4fb6-bf9e-db1041158e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.459091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb924bd7-b0b5-4fb6-bf9e-db1041158e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.460933 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb924bd7-b0b5-4fb6-bf9e-db1041158e1d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.471980 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1171/2319] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:08.476494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb924bd7-b0b5-4fb6-bf9e-db1041158e1d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.486315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb924bd7-b0b5-4fb6-bf9e-db1041158e1d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.491275 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e1c9-62a1-4d84-be23-908a35a95107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.491863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e1c9-62a1-4d84-be23-908a35a95107 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.492138 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e1c9-62a1-4d84-be23-908a35a95107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.492406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e1c9-62a1-4d84-be23-908a35a95107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.493035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80e1c9-62a1-4d84-be23-908a35a95107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.493386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4038f9b018644faab9afe617d5eecc50'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.494044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4038f9b018644faab9afe617d5eecc50'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.494620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80e1c9-62a1-4d84-be23-908a35a95107 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.495251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:08.503068 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4038f9b018644faab9afe617d5eecc50'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.509255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1172/2320] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:08.510389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e1c9-62a1-4d84-be23-908a35a95107 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.512317 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ee80e1c9-62a1-4d84-be23-908a35a95107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:08.516520 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4038f9b018644faab9afe617d5eecc50'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.517232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-04cdb427-3f32-4111-a0f1-51f6250bc723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4038f9b018644faab9afe617d5eecc50'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:08.525456 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e1c9-62a1-4d84-be23-908a35a95107 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.530338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b547c-f3d8-493a-bd2f-40b1a31d2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.531014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b547c-f3d8-493a-bd2f-40b1a31d2242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.531290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b547c-f3d8-493a-bd2f-40b1a31d2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.531558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b547c-f3d8-493a-bd2f-40b1a31d2242 admin admin] PATH_INFO: `/v3/projects/fd4e9d91abd94a919eb64c9a0d58033a/users/cbb2c47aefed45f3abfc8919693aa61b/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.533934 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1149/2321] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:08 2022] DELETE /identity/v3/users/4038f9b018644faab9afe617d5eecc50 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:08.538555 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42052a-79be-460a-be87-6e8bb5a4c3d7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.538836 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42052a-79be-460a-be87-6e8bb5a4c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.539135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42052a-79be-460a-be87-6e8bb5a4c3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.547680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b547c-f3d8-493a-bd2f-40b1a31d2242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4e9d91abd94a919eb64c9a0d58033a, user_id=cbb2c47aefed45f3abfc8919693aa61b, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.551224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b547c-f3d8-493a-bd2f-40b1a31d2242 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.559665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ee42052a-79be-460a-be87-6e8bb5a4c3d7 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:08.560872 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ee42052a-79be-460a-be87-6e8bb5a4c3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:08.568372 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1173/2322] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:08 2022] PUT /identity/v3/projects/fd4e9d91abd94a919eb64c9a0d58033a/users/cbb2c47aefed45f3abfc8919693aa61b/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:08.573077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f099fa-ff6f-4a5c-bdd4-e80e004a4472 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.573359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f099fa-ff6f-4a5c-bdd4-e80e004a4472 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.573634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f099fa-ff6f-4a5c-bdd4-e80e004a4472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.595019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a7f099fa-ff6f-4a5c-bdd4-e80e004a4472 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:08.596220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a7f099fa-ff6f-4a5c-bdd4-e80e004a4472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:08.619835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1150/2323] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:08.620725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:08.631615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42052a-79be-460a-be87-6e8bb5a4c3d7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.632553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ee42052a-79be-460a-be87-6e8bb5a4c3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:08.663121 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1174/2324] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:08.677018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f099fa-ff6f-4a5c-bdd4-e80e004a4472 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:08.678482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a7f099fa-ff6f-4a5c-bdd4-e80e004a4472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:08.693209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42052a-79be-460a-be87-6e8bb5a4c3d7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.696824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52992799-794e-49c7-802c-86a32e8482b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.697437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992799-794e-49c7-802c-86a32e8482b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.697713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992799-794e-49c7-802c-86a32e8482b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.697987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992799-794e-49c7-802c-86a32e8482b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.707497 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52992799-794e-49c7-802c-86a32e8482b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.708923 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52992799-794e-49c7-802c-86a32e8482b2 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.718300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1151/2325] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:08.740391 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f099fa-ff6f-4a5c-bdd4-e80e004a4472 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:08.744118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea790c-2412-463e-b6b4-f90231a69c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:08.744793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea790c-2412-463e-b6b4-f90231a69c7f service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:08.745071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea790c-2412-463e-b6b4-f90231a69c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:08.745362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea790c-2412-463e-b6b4-f90231a69c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:08.755549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea790c-2412-463e-b6b4-f90231a69c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:08.757015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea790c-2412-463e-b6b4-f90231a69c7f service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:08.766857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1175/2326] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:09.149426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52992799-794e-49c7-802c-86a32e8482b2 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:09.151840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-52992799-794e-49c7-802c-86a32e8482b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:09.168287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52992799-794e-49c7-802c-86a32e8482b2 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:09.173571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:09.174277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:09.174885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:09.175255 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] PATH_INFO: `/v3/projects/6b54df391ba24e4abf6e52ea6a417723` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:09.176541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b54df391ba24e4abf6e52ea6a417723)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:09.178749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:09.254855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b54df391ba24e4abf6e52ea6a417723', 'request_id': 'req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.269000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b54df391ba24e4abf6e52ea6a417723', 'request_id': 'req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.275614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b54df391ba24e4abf6e52ea6a417723', 'request_id': 'req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.277444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:09.293320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] The token cache is being invalidate because project 6b54df391ba24e4abf6e52ea6a417723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:09.293841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.294728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68bb5024-b295-4ac2-bc00-11dfcd7d02bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.296636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1152/2327] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:09 2022] DELETE /identity/v3/projects/6b54df391ba24e4abf6e52ea6a417723 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:09.301873 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea790c-2412-463e-b6b4-f90231a69c7f service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:09.312061 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea790c-2412-463e-b6b4-f90231a69c7f service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:09.382883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:09.383746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:09.384909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:09.385421 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] PATH_INFO: `/v3/users/f93f05ec34814ed1b3cce14bcb5e1121` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:09.387597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93f05ec34814ed1b3cce14bcb5e1121)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:09.389182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:09.446378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93f05ec34814ed1b3cce14bcb5e1121'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.447055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93f05ec34814ed1b3cce14bcb5e1121'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.454592 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93f05ec34814ed1b3cce14bcb5e1121'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.469035 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93f05ec34814ed1b3cce14bcb5e1121'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.469937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93f05ec34814ed1b3cce14bcb5e1121'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.473071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:09.491659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1176/2328] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:09 2022] DELETE /identity/v3/users/f93f05ec34814ed1b3cce14bcb5e1121 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:09.669015 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdb7d3-6eb5-4ffb-b609-5b4bbd43fea5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:09.669990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdb7d3-6eb5-4ffb-b609-5b4bbd43fea5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:09.669990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdb7d3-6eb5-4ffb-b609-5b4bbd43fea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:09.690597 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:09.692352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:09.735941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-85bdb7d3-6eb5-4ffb-b609-5b4bbd43fea5 None None] MFA Rules not processed for user `cbb2c47aefed45f3abfc8919693aa61b`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:09.739519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-85bdb7d3-6eb5-4ffb-b609-5b4bbd43fea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:09.794560 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe5fa7-e5bd-4aab-8ea8-4509a7893b39 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:09.800306 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:09.801490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:09.801490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:09.801706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] PATH_INFO: `/v3/users/7cfdf248e9be4ac985d7a4b48b940a81` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:09.802871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfdf248e9be4ac985d7a4b48b940a81)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:09.804935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:09.862116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1153/2329] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:09.875573 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfdf248e9be4ac985d7a4b48b940a81'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.876617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfdf248e9be4ac985d7a4b48b940a81'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.879169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdb7d3-6eb5-4ffb-b609-5b4bbd43fea5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:09.884054 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-85bdb7d3-6eb5-4ffb-b609-5b4bbd43fea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:09.889982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfdf248e9be4ac985d7a4b48b940a81'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.914157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfdf248e9be4ac985d7a4b48b940a81'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.915208 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfdf248e9be4ac985d7a4b48b940a81'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:09.933333 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1177/2330] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:09 2022] DELETE /identity/v3/users/7cfdf248e9be4ac985d7a4b48b940a81 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:09.934220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:09.936038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:09.965456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdb7d3-6eb5-4ffb-b609-5b4bbd43fea5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.011703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b770-7090-45ca-8ab2-b9271d16bfbe admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.017334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.017965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.018236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.018594 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] PATH_INFO: `/v3/projects/9cc301ae620945eeb54e152db225f83b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.019772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc301ae620945eeb54e152db225f83b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.021749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.025766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.026617 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.027259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.027541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.029768 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.033767 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:10.079678 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc301ae620945eeb54e152db225f83b', 'request_id': 'req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.086378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc301ae620945eeb54e152db225f83b', 'request_id': 'req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.090784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:10.092740 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc301ae620945eeb54e152db225f83b', 'request_id': 'req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.105198 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.106831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.107378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] The token cache is being invalidate because project 9cc301ae620945eeb54e152db225f83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:10.107633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.108387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52cdc8f4-5feb-4a3e-93a7-a43d6b62fd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.111324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1178/2331] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:09 2022] DELETE /identity/v3/projects/9cc301ae620945eeb54e152db225f83b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:10.116450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81ed23-6cc5-448a-a68d-76a6063e1570 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.116772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81ed23-6cc5-448a-a68d-76a6063e1570 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.117047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81ed23-6cc5-448a-a68d-76a6063e1570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.119105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1154/2332] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:10.128686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.130158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.141342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-eb81ed23-6cc5-448a-a68d-76a6063e1570 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:10.142610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-eb81ed23-6cc5-448a-a68d-76a6063e1570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.145279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5f7b3-20d1-4fc8-9513-5b28612e5343 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.216437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.217195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.217565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.217947 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] PATH_INFO: `/v3/projects/ba1214fa8009443e95e105138be0738c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.219282 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1214fa8009443e95e105138be0738c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.221681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1179/2333] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:10.221835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.229674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12618b-36bd-4fd1-82c6-3fad1fba35a9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.229960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12618b-36bd-4fd1-82c6-3fad1fba35a9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.230227 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12618b-36bd-4fd1-82c6-3fad1fba35a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.250515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0f12618b-36bd-4fd1-82c6-3fad1fba35a9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:10.252117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0f12618b-36bd-4fd1-82c6-3fad1fba35a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.263076 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1180/2334] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:10.265251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12618b-36bd-4fd1-82c6-3fad1fba35a9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.274430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12618b-36bd-4fd1-82c6-3fad1fba35a9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.278630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1214fa8009443e95e105138be0738c', 'request_id': 'req-75686e2d-fb82-4ff7-9deb-549b122d5cc4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.286041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1214fa8009443e95e105138be0738c', 'request_id': 'req-75686e2d-fb82-4ff7-9deb-549b122d5cc4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.292689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1214fa8009443e95e105138be0738c', 'request_id': 'req-75686e2d-fb82-4ff7-9deb-549b122d5cc4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.308349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] The token cache is being invalidate because project ba1214fa8009443e95e105138be0738c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:10.308924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.309630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75686e2d-fb82-4ff7-9deb-549b122d5cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:10.311193 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1155/2335] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:10 2022] DELETE /identity/v3/projects/ba1214fa8009443e95e105138be0738c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:10.316185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffebdf9-bdc3-42f6-b6d6-e45956315438 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.316565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffebdf9-bdc3-42f6-b6d6-e45956315438 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.317072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffebdf9-bdc3-42f6-b6d6-e45956315438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.337263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-dffebdf9-bdc3-42f6-b6d6-e45956315438 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:10.338533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dffebdf9-bdc3-42f6-b6d6-e45956315438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.339293 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.339945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.340223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.340494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.341190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:10.341487 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.343168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.349292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1156/2336] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:10.359284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870190-ee12-4889-b25d-ff79e450b649 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.359649 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870190-ee12-4889-b25d-ff79e450b649 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.359983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870190-ee12-4889-b25d-ff79e450b649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.361711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1181/2337] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:10.366266 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.368118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.383373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6a870190-ee12-4889-b25d-ff79e450b649 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:10.384846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6a870190-ee12-4889-b25d-ff79e450b649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.385668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e33332-c05f-48c7-b31f-bf38a9c2d653 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.394334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1157/2338] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:10.396846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa5c3-14ef-4f0a-8be3-3ebc804d8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.397988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa5c3-14ef-4f0a-8be3-3ebc804d8305 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.398540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a870190-ee12-4889-b25d-ff79e450b649 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.398668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa5c3-14ef-4f0a-8be3-3ebc804d8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.399051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa5c3-14ef-4f0a-8be3-3ebc804d8305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.399786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fa5c3-14ef-4f0a-8be3-3ebc804d8305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.401815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fa5c3-14ef-4f0a-8be3-3ebc804d8305 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.415950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a870190-ee12-4889-b25d-ff79e450b649 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.421487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128ec52-c927-4466-8c54-3019101ffc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.422751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128ec52-c927-4466-8c54-3019101ffc77 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.423206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128ec52-c927-4466-8c54-3019101ffc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.423479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128ec52-c927-4466-8c54-3019101ffc77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.426733 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128ec52-c927-4466-8c54-3019101ffc77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:10.427136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128ec52-c927-4466-8c54-3019101ffc77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.428815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128ec52-c927-4466-8c54-3019101ffc77 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.446050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1158/2339] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:10.447259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128ec52-c927-4466-8c54-3019101ffc77 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.447973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1182/2340] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:10.451590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa5c3-14ef-4f0a-8be3-3ebc804d8305 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.462367 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:10.468613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128ec52-c927-4466-8c54-3019101ffc77 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.529157 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa5c3-14ef-4f0a-8be3-3ebc804d8305 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.534906 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93572c3-3646-4d22-b3a3-96c4451089d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.535668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93572c3-3646-4d22-b3a3-96c4451089d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.536100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93572c3-3646-4d22-b3a3-96c4451089d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.536284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:10.536445 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93572c3-3646-4d22-b3a3-96c4451089d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.537067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93572c3-3646-4d22-b3a3-96c4451089d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.539864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93572c3-3646-4d22-b3a3-96c4451089d4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.545161 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2b6a3-7205-4703-9d75-63c4bf8acc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.546020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2b6a3-7205-4703-9d75-63c4bf8acc61 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.546627 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2b6a3-7205-4703-9d75-63c4bf8acc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.547124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2b6a3-7205-4703-9d75-63c4bf8acc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.547961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2b6a3-7205-4703-9d75-63c4bf8acc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.550659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2b6a3-7205-4703-9d75-63c4bf8acc61 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.567064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1183/2341] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:10.568374 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93572c3-3646-4d22-b3a3-96c4451089d4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.580135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93572c3-3646-4d22-b3a3-96c4451089d4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.583788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1159/2342] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:10.584886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2b6a3-7205-4703-9d75-63c4bf8acc61 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.639950 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113c982-d09f-434d-975f-664dc65087e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.640577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c982-d09f-434d-975f-664dc65087e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.640870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c982-d09f-434d-975f-664dc65087e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.641133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c982-d09f-434d-975f-664dc65087e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.641769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113c982-d09f-434d-975f-664dc65087e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.643634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113c982-d09f-434d-975f-664dc65087e2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.648019 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2b6a3-7205-4703-9d75-63c4bf8acc61 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.652630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d76a-4bc1-40ed-9df7-d143a067d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.653223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d76a-4bc1-40ed-9df7-d143a067d40d admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.653429 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1184/2343] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:10.653814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d76a-4bc1-40ed-9df7-d143a067d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.654162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d76a-4bc1-40ed-9df7-d143a067d40d admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.654797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793d76a-4bc1-40ed-9df7-d143a067d40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.657001 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793d76a-4bc1-40ed-9df7-d143a067d40d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.657327 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113c982-d09f-434d-975f-664dc65087e2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.666712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113c982-d09f-434d-975f-664dc65087e2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.672133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b48d7-1661-48f6-859b-38265b872cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.672774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b48d7-1661-48f6-859b-38265b872cee admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.673044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b48d7-1661-48f6-859b-38265b872cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.673308 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b48d7-1661-48f6-859b-38265b872cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.673935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b48d7-1661-48f6-859b-38265b872cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.676551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b48d7-1661-48f6-859b-38265b872cee admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.682241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1160/2344] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:10.683360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d76a-4bc1-40ed-9df7-d143a067d40d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.687234 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1185/2345] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:10.691466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b48d7-1661-48f6-859b-38265b872cee admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.693550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d76a-4bc1-40ed-9df7-d143a067d40d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.699185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a398949-8f64-4b63-b425-6763a67e0532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.699725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a398949-8f64-4b63-b425-6763a67e0532 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.700021 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a398949-8f64-4b63-b425-6763a67e0532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.700284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a398949-8f64-4b63-b425-6763a67e0532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.700919 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a398949-8f64-4b63-b425-6763a67e0532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.701024 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b48d7-1661-48f6-859b-38265b872cee admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.702523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a398949-8f64-4b63-b425-6763a67e0532 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.705761 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0dfbd-9457-4b8d-9f7a-f5a475e2bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.706801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0dfbd-9457-4b8d-9f7a-f5a475e2bc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.707107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0dfbd-9457-4b8d-9f7a-f5a475e2bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.707376 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0dfbd-9457-4b8d-9f7a-f5a475e2bc59 admin admin] PATH_INFO: `/v3/projects/765656970ade4e078b2868fba4b545a0/users/fabc24dcfd4348828ed89a10ae9baf02/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.713508 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1161/2346] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:10.717505 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a398949-8f64-4b63-b425-6763a67e0532 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.723721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0dfbd-9457-4b8d-9f7a-f5a475e2bc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765656970ade4e078b2868fba4b545a0, user_id=fabc24dcfd4348828ed89a10ae9baf02, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.726600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0dfbd-9457-4b8d-9f7a-f5a475e2bc59 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.728234 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a398949-8f64-4b63-b425-6763a67e0532 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.732956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceb947-6c86-403e-ae30-9aa16fa5c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.733605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceb947-6c86-403e-ae30-9aa16fa5c58f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.733875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceb947-6c86-403e-ae30-9aa16fa5c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.734131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceb947-6c86-403e-ae30-9aa16fa5c58f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.734794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ceb947-6c86-403e-ae30-9aa16fa5c58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.736429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ceb947-6c86-403e-ae30-9aa16fa5c58f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.742051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1186/2347] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:10 2022] PUT /identity/v3/projects/765656970ade4e078b2868fba4b545a0/users/fabc24dcfd4348828ed89a10ae9baf02/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:10.752922 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1162/2348] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:10.753113 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839cf76-01c3-4f50-ae1a-0360bec196f9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.753226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839cf76-01c3-4f50-ae1a-0360bec196f9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.753459 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839cf76-01c3-4f50-ae1a-0360bec196f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.754231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceb947-6c86-403e-ae30-9aa16fa5c58f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.764128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceb947-6c86-403e-ae30-9aa16fa5c58f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.783354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e839cf76-01c3-4f50-ae1a-0360bec196f9 None None] MFA Rules not processed for user `fabc24dcfd4348828ed89a10ae9baf02`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:10.784646 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e839cf76-01c3-4f50-ae1a-0360bec196f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.824507 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9f94e-8786-4068-834f-199c1cf9332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.825202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f94e-8786-4068-834f-199c1cf9332c admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.825479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f94e-8786-4068-834f-199c1cf9332c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.825756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f94e-8786-4068-834f-199c1cf9332c admin admin] PATH_INFO: `/v3/projects/e89bbf606b0840a6bd669a895a846675/users/6b81558d71f84856b9fb079f88158896/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.830648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:10.840642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9f94e-8786-4068-834f-199c1cf9332c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89bbf606b0840a6bd669a895a846675, user_id=6b81558d71f84856b9fb079f88158896, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.843327 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9f94e-8786-4068-834f-199c1cf9332c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.851742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1187/2349] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:10.856187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839cf76-01c3-4f50-ae1a-0360bec196f9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.861334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1163/2350] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:10 2022] PUT /identity/v3/projects/e89bbf606b0840a6bd669a895a846675/users/6b81558d71f84856b9fb079f88158896/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:10.866499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d32a2-d16f-4bca-b028-f6ba7c855b21 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.866791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d32a2-d16f-4bca-b028-f6ba7c855b21 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.867223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d32a2-d16f-4bca-b028-f6ba7c855b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.870534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839cf76-01c3-4f50-ae1a-0360bec196f9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:10.886846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-451d32a2-d16f-4bca-b028-f6ba7c855b21 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:10.888078 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-451d32a2-d16f-4bca-b028-f6ba7c855b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.914713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:10.929379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d0f11-650c-4820-9bf3-f9172b9dad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:10.929992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d0f11-650c-4820-9bf3-f9172b9dad16 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:10.930258 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d0f11-650c-4820-9bf3-f9172b9dad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:10.930512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d0f11-650c-4820-9bf3-f9172b9dad16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:10.931161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d0f11-650c-4820-9bf3-f9172b9dad16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:10.933070 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d0f11-650c-4820-9bf3-f9172b9dad16 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:10.949354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1164/2351] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:10.959163 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d32a2-d16f-4bca-b028-f6ba7c855b21 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:10.960679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-451d32a2-d16f-4bca-b028-f6ba7c855b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:10.966843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1188/2352] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:10.967669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d0f11-650c-4820-9bf3-f9172b9dad16 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:11.020981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d32a2-d16f-4bca-b028-f6ba7c855b21 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:11.030378 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d0f11-650c-4820-9bf3-f9172b9dad16 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:11.035312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dfe08-51d2-4296-a5d4-9828c033864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:11.035923 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dfe08-51d2-4296-a5d4-9828c033864d admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:11.036197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dfe08-51d2-4296-a5d4-9828c033864d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:11.036471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dfe08-51d2-4296-a5d4-9828c033864d admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:11.037093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dfe08-51d2-4296-a5d4-9828c033864d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:11.039064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dfe08-51d2-4296-a5d4-9828c033864d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:11.061979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1189/2353] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:10 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:11.065971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dfe08-51d2-4296-a5d4-9828c033864d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:11.070757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ad89-f638-44d7-ac31-3760279e0a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:11.071391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ad89-f638-44d7-ac31-3760279e0a35 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:11.071667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ad89-f638-44d7-ac31-3760279e0a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:11.071937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ad89-f638-44d7-ac31-3760279e0a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:11.075472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dfe08-51d2-4296-a5d4-9828c033864d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:11.080087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e840892-6803-4d46-b44b-e8db3ffbee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:11.080664 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840892-6803-4d46-b44b-e8db3ffbee7e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:11.080971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840892-6803-4d46-b44b-e8db3ffbee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:11.081155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ad89-f638-44d7-ac31-3760279e0a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:11.081281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840892-6803-4d46-b44b-e8db3ffbee7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:11.082018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e840892-6803-4d46-b44b-e8db3ffbee7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:11.082474 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ad89-f638-44d7-ac31-3760279e0a35 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:11.083677 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e840892-6803-4d46-b44b-e8db3ffbee7e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:11.092196 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1165/2354] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:51:11.094179 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1190/2355] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:11.098208 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ad89-f638-44d7-ac31-3760279e0a35 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:11.107453 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ad89-f638-44d7-ac31-3760279e0a35 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:11.112311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e478eb-562a-4e67-aebd-62af08a13594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:11.112953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e478eb-562a-4e67-aebd-62af08a13594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:11.113224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e478eb-562a-4e67-aebd-62af08a13594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:11.113774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e478eb-562a-4e67-aebd-62af08a13594 admin admin] PATH_INFO: `/v3/projects/493b641c89dc4e81981fc5fc2113b3bc/users/207fd67ccbbc46d1bf448bdec9013956/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:11.130412 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e478eb-562a-4e67-aebd-62af08a13594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493b641c89dc4e81981fc5fc2113b3bc, user_id=207fd67ccbbc46d1bf448bdec9013956, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:11.133148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e478eb-562a-4e67-aebd-62af08a13594 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:11.147380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1166/2356] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:11 2022] PUT /identity/v3/projects/493b641c89dc4e81981fc5fc2113b3bc/users/207fd67ccbbc46d1bf448bdec9013956/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:11.151472 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e840892-6803-4d46-b44b-e8db3ffbee7e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:11.161379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e840892-6803-4d46-b44b-e8db3ffbee7e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:11.210362 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:11.223027 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e67f9-6a38-4c94-ac53-665065f411be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:11.223931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e67f9-6a38-4c94-ac53-665065f411be admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:11.224202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e67f9-6a38-4c94-ac53-665065f411be admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:11.224482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e67f9-6a38-4c94-ac53-665065f411be admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:11.225107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e67f9-6a38-4c94-ac53-665065f411be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:11.226824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e67f9-6a38-4c94-ac53-665065f411be admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:11.238314 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1191/2357] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:11.242200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e478eb-562a-4e67-aebd-62af08a13594 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:11.253646 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e478eb-562a-4e67-aebd-62af08a13594 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:11.258298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52ffb1-8e2b-40be-b1cc-1eaeba1c4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:11.259013 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52ffb1-8e2b-40be-b1cc-1eaeba1c4b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:11.259288 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52ffb1-8e2b-40be-b1cc-1eaeba1c4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:11.259578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52ffb1-8e2b-40be-b1cc-1eaeba1c4b78 admin admin] PATH_INFO: `/v3/projects/493b641c89dc4e81981fc5fc2113b3bc/users/207fd67ccbbc46d1bf448bdec9013956/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:11.261578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52ffb1-8e2b-40be-b1cc-1eaeba1c4b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493b641c89dc4e81981fc5fc2113b3bc, user_id=207fd67ccbbc46d1bf448bdec9013956, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:11.264543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52ffb1-8e2b-40be-b1cc-1eaeba1c4b78 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:11.278867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1167/2358] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:11 2022] PUT /identity/v3/projects/493b641c89dc4e81981fc5fc2113b3bc/users/207fd67ccbbc46d1bf448bdec9013956/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:11.290147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a580a9-ca42-4e8f-90d4-27410bbfcc2b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:11.290428 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a580a9-ca42-4e8f-90d4-27410bbfcc2b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:11.290697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a580a9-ca42-4e8f-90d4-27410bbfcc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:11.318610 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e9a580a9-ca42-4e8f-90d4-27410bbfcc2b None None] MFA Rules not processed for user `207fd67ccbbc46d1bf448bdec9013956`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:11.319852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e9a580a9-ca42-4e8f-90d4-27410bbfcc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:11.400263 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1192/2359] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:11.409214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52ffb1-8e2b-40be-b1cc-1eaeba1c4b78 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:11.411413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cb52ffb1-8e2b-40be-b1cc-1eaeba1c4b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:11.481971 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52ffb1-8e2b-40be-b1cc-1eaeba1c4b78 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:11.485812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2e51-3288-42e0-bd13-34fdf5f08f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:11.486541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2e51-3288-42e0-bd13-34fdf5f08f98 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:11.486885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2e51-3288-42e0-bd13-34fdf5f08f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:11.487343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2e51-3288-42e0-bd13-34fdf5f08f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:11.499320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:11.502644 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d2e51-3288-42e0-bd13-34fdf5f08f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:11.509271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d2e51-3288-42e0-bd13-34fdf5f08f98 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:11.522040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1168/2360] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:11.564059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e25470-e877-4532-a258-eb12b7552f04 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:11.564364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e25470-e877-4532-a258-eb12b7552f04 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:11.564743 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e25470-e877-4532-a258-eb12b7552f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:11.586844 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e6e25470-e877-4532-a258-eb12b7552f04 None None] MFA Rules not processed for user `cbb2c47aefed45f3abfc8919693aa61b`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:11.588484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e6e25470-e877-4532-a258-eb12b7552f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:11.649480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1193/2361] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:13.287541 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2e51-3288-42e0-bd13-34fdf5f08f98 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:13.367946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2e51-3288-42e0-bd13-34fdf5f08f98 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:13.374085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:13.374956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:13.379885 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:13.380531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] PATH_INFO: `/v3/users/fabc24dcfd4348828ed89a10ae9baf02` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:13.382302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fabc24dcfd4348828ed89a10ae9baf02)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:13.385740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:13.457124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fabc24dcfd4348828ed89a10ae9baf02'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:13.458099 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fabc24dcfd4348828ed89a10ae9baf02'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:13.467098 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fabc24dcfd4348828ed89a10ae9baf02'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:13.482369 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fabc24dcfd4348828ed89a10ae9baf02'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:13.483170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fabc24dcfd4348828ed89a10ae9baf02'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:13.503330 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1169/2362] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:13 2022] DELETE /identity/v3/users/fabc24dcfd4348828ed89a10ae9baf02 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:13.510132 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02fea3-e98b-4318-bb69-104af975eefd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:13.511131 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02fea3-e98b-4318-bb69-104af975eefd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:13.511983 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02fea3-e98b-4318-bb69-104af975eefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:13.535912 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3f02fea3-e98b-4318-bb69-104af975eefd None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:13.537245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3f02fea3-e98b-4318-bb69-104af975eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:13.602380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1194/2363] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:13.613446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:13.614909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:13.688782 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191b4ba-8101-46e6-9594-e8c77165bdfc admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:13.695842 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8bea2-7c1d-414c-a1fa-339875cd83b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:13.696629 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8bea2-7c1d-414c-a1fa-339875cd83b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:13.696972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8bea2-7c1d-414c-a1fa-339875cd83b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:13.697308 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8bea2-7c1d-414c-a1fa-339875cd83b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:13.710370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8bea2-7c1d-414c-a1fa-339875cd83b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:13.711855 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8bea2-7c1d-414c-a1fa-339875cd83b5 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:13.722936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1170/2364] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:14.228738 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02fea3-e98b-4318-bb69-104af975eefd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:14.233984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3f02fea3-e98b-4318-bb69-104af975eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:14.247049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02fea3-e98b-4318-bb69-104af975eefd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:14.251992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:14.252676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:14.252955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:14.253217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] PATH_INFO: `/v3/projects/765656970ade4e078b2868fba4b545a0` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:14.255239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765656970ade4e078b2868fba4b545a0)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:14.256436 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:14.275163 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:14.342800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765656970ade4e078b2868fba4b545a0', 'request_id': 'req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.349926 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765656970ade4e078b2868fba4b545a0', 'request_id': 'req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.360555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765656970ade4e078b2868fba4b545a0', 'request_id': 'req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.380307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] The token cache is being invalidate because project 765656970ade4e078b2868fba4b545a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:14.380795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.381627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.384067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1195/2365] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:14 2022] DELETE /identity/v3/projects/765656970ade4e078b2868fba4b545a0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:14.388366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8bea2-7c1d-414c-a1fa-339875cd83b5 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:14.399169 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8bea2-7c1d-414c-a1fa-339875cd83b5 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:14.420956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:14.505545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:14.506391 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:14.506666 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:14.506950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] PATH_INFO: `/v3/users/207fd67ccbbc46d1bf448bdec9013956` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:14.508350 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=207fd67ccbbc46d1bf448bdec9013956)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:14.510624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:14.596269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207fd67ccbbc46d1bf448bdec9013956'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.597727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207fd67ccbbc46d1bf448bdec9013956'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.612793 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207fd67ccbbc46d1bf448bdec9013956'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.628832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207fd67ccbbc46d1bf448bdec9013956'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.629972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ed5f435-81c2-4d2a-a6f4-27522eda7faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207fd67ccbbc46d1bf448bdec9013956'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:14.659248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1171/2366] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:14 2022] DELETE /identity/v3/users/207fd67ccbbc46d1bf448bdec9013956 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:15.270699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:15.272231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:15.290030 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c9b76-4d98-49e5-bf9c-ae6b99fe09c8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:15.396836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:15.397755 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:15.398493 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:15.398971 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] PATH_INFO: `/v3/projects/493b641c89dc4e81981fc5fc2113b3bc` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:15.400584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493b641c89dc4e81981fc5fc2113b3bc)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:15.404301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:15.485007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493b641c89dc4e81981fc5fc2113b3bc', 'request_id': 'req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:15.512083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493b641c89dc4e81981fc5fc2113b3bc', 'request_id': 'req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:15.522617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493b641c89dc4e81981fc5fc2113b3bc', 'request_id': 'req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:15.553307 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] The token cache is being invalidate because project 493b641c89dc4e81981fc5fc2113b3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:15.553839 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:15.555603 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ac0cb16c-7194-4ccb-92ae-7ae8d1b47860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:15.558478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1196/2367] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:15 2022] DELETE /identity/v3/projects/493b641c89dc4e81981fc5fc2113b3bc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:15.563955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73874f-9dba-4d93-a871-9869320a5581 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:15.564935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73874f-9dba-4d93-a871-9869320a5581 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:15.565564 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73874f-9dba-4d93-a871-9869320a5581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:15.590470 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5e73874f-9dba-4d93-a871-9869320a5581 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:15.591937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5e73874f-9dba-4d93-a871-9869320a5581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:15.683584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1172/2368] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:15.693006 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e80b9-09b4-4f2a-acb8-1cdfd3e38844 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:15.693854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e80b9-09b4-4f2a-acb8-1cdfd3e38844 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:15.694309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e80b9-09b4-4f2a-acb8-1cdfd3e38844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:15.738797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ff5e80b9-09b4-4f2a-acb8-1cdfd3e38844 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:15.740686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ff5e80b9-09b4-4f2a-acb8-1cdfd3e38844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:15.765617 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1197/2369] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:15.771296 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73874f-9dba-4d93-a871-9869320a5581 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:15.785314 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73874f-9dba-4d93-a871-9869320a5581 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:15.801924 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3697d-ae48-4715-8444-95458da37e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:15.802375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3697d-ae48-4715-8444-95458da37e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:15.802653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3697d-ae48-4715-8444-95458da37e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:15.802954 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3697d-ae48-4715-8444-95458da37e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:15.803736 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3697d-ae48-4715-8444-95458da37e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:15.803907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3697d-ae48-4715-8444-95458da37e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:15.805518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3697d-ae48-4715-8444-95458da37e5a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:15.829350 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e80b9-09b4-4f2a-acb8-1cdfd3e38844 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:15.829587 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1173/2370] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:15.839414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e80b9-09b4-4f2a-acb8-1cdfd3e38844 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:15.855360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9f14b-e4bf-4075-91f5-2c6007022e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:15.856123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9f14b-e4bf-4075-91f5-2c6007022e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:15.856469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9f14b-e4bf-4075-91f5-2c6007022e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:15.856824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9f14b-e4bf-4075-91f5-2c6007022e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:15.857673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9f14b-e4bf-4075-91f5-2c6007022e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:15.860537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9f14b-e4bf-4075-91f5-2c6007022e8c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:15.907581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1198/2371] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:15 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:15.911659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3697d-ae48-4715-8444-95458da37e5a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:15.923147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3697d-ae48-4715-8444-95458da37e5a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:15.945210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:15.998075 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd21c-fde1-4749-a8f5-c257a5ffbffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:15.998797 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd21c-fde1-4749-a8f5-c257a5ffbffb admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:15.999305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd21c-fde1-4749-a8f5-c257a5ffbffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:15.999553 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd21c-fde1-4749-a8f5-c257a5ffbffb admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:16.000681 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfd21c-fde1-4749-a8f5-c257a5ffbffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:16.004708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfd21c-fde1-4749-a8f5-c257a5ffbffb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:16.042978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1174/2372] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:15 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:16.046417 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9f14b-e4bf-4075-91f5-2c6007022e8c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:16.053090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:16.062274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9f14b-e4bf-4075-91f5-2c6007022e8c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:16.075709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf56f5-677e-4af1-87a1-e66a22a0d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:16.076612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf56f5-677e-4af1-87a1-e66a22a0d8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:16.076960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf56f5-677e-4af1-87a1-e66a22a0d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:16.077303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf56f5-677e-4af1-87a1-e66a22a0d8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:16.078031 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf56f5-677e-4af1-87a1-e66a22a0d8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:16.079766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf56f5-677e-4af1-87a1-e66a22a0d8a7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:16.091338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1199/2373] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:16.095395 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd21c-fde1-4749-a8f5-c257a5ffbffb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:16.109625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd21c-fde1-4749-a8f5-c257a5ffbffb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:16.117909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c47df-099e-48b1-a32d-48a990f8f72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:16.119467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c47df-099e-48b1-a32d-48a990f8f72d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:16.120485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c47df-099e-48b1-a32d-48a990f8f72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:16.120961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c47df-099e-48b1-a32d-48a990f8f72d admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:16.121913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c47df-099e-48b1-a32d-48a990f8f72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:16.123754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c47df-099e-48b1-a32d-48a990f8f72d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:16.136438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1175/2374] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:16.140687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf56f5-677e-4af1-87a1-e66a22a0d8a7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:16.156965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf56f5-677e-4af1-87a1-e66a22a0d8a7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:16.162257 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac199c-0e62-43c8-b932-43094b516863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:16.162957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac199c-0e62-43c8-b932-43094b516863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:16.163331 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac199c-0e62-43c8-b932-43094b516863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:16.163724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac199c-0e62-43c8-b932-43094b516863 admin admin] PATH_INFO: `/v3/projects/5827038eff07474585dafa0c267218cd/users/73eb640d956148cdba2721371d728e04/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:16.182672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac199c-0e62-43c8-b932-43094b516863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5827038eff07474585dafa0c267218cd, user_id=73eb640d956148cdba2721371d728e04, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:16.185645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac199c-0e62-43c8-b932-43094b516863 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:16.215989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1200/2375] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:16 2022] PUT /identity/v3/projects/5827038eff07474585dafa0c267218cd/users/73eb640d956148cdba2721371d728e04/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:16.217869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945739-54ce-4aae-88da-864681940f76 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:16.218214 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945739-54ce-4aae-88da-864681940f76 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:16.218511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945739-54ce-4aae-88da-864681940f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:16.252487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3e945739-54ce-4aae-88da-864681940f76 None None] MFA Rules not processed for user `73eb640d956148cdba2721371d728e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:16.254113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3e945739-54ce-4aae-88da-864681940f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:16.357751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1176/2376] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:16.366655 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac199c-0e62-43c8-b932-43094b516863 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:16.369303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5cac199c-0e62-43c8-b932-43094b516863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:16.491278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac199c-0e62-43c8-b932-43094b516863 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:16.500477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06930813-9302-4e1c-816f-4f633f0601ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:16.502067 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06930813-9302-4e1c-816f-4f633f0601ff service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:16.502716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06930813-9302-4e1c-816f-4f633f0601ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:16.503218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06930813-9302-4e1c-816f-4f633f0601ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:16.516300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06930813-9302-4e1c-816f-4f633f0601ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:16.518775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06930813-9302-4e1c-816f-4f633f0601ff service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:16.536243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1201/2377] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:16.635064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ff52-8671-4dbd-bf21-b61b3ed37d53 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:16.635529 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ff52-8671-4dbd-bf21-b61b3ed37d53 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:16.635613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ff52-8671-4dbd-bf21-b61b3ed37d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:16.679679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-97e9ff52-8671-4dbd-bf21-b61b3ed37d53 None None] MFA Rules not processed for user `6b81558d71f84856b9fb079f88158896`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:16.681152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-97e9ff52-8671-4dbd-bf21-b61b3ed37d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:16.765051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1177/2378] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:16.770044 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06930813-9302-4e1c-816f-4f633f0601ff service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:16.771632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-06930813-9302-4e1c-816f-4f633f0601ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:16.886489 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06930813-9302-4e1c-816f-4f633f0601ff service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:16.891297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc19702-bde2-41ed-8c00-2253c63d178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:16.892018 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc19702-bde2-41ed-8c00-2253c63d178d admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:16.892361 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc19702-bde2-41ed-8c00-2253c63d178d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:16.892709 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc19702-bde2-41ed-8c00-2253c63d178d admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:16.893511 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc19702-bde2-41ed-8c00-2253c63d178d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:16.895604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc19702-bde2-41ed-8c00-2253c63d178d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:16.938579 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1202/2379] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:16 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:16.939393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9ff52-8671-4dbd-bf21-b61b3ed37d53 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:16.958451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9ff52-8671-4dbd-bf21-b61b3ed37d53 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:16.984528 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:17.036267 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1e05e-b9e1-4d0e-bb22-1b32653c51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:17.037064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1e05e-b9e1-4d0e-bb22-1b32653c51da admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:17.037415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1e05e-b9e1-4d0e-bb22-1b32653c51da admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:17.037784 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1e05e-b9e1-4d0e-bb22-1b32653c51da admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:17.038528 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1e05e-b9e1-4d0e-bb22-1b32653c51da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:17.040651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1e05e-b9e1-4d0e-bb22-1b32653c51da admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:17.070966 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1178/2380] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:16 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:17.073574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc19702-bde2-41ed-8c00-2253c63d178d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:17.084775 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc19702-bde2-41ed-8c00-2253c63d178d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:17.090385 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce174d9-ef90-4c6b-9ae4-ea00ab3fabb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:17.091125 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce174d9-ef90-4c6b-9ae4-ea00ab3fabb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:17.091469 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce174d9-ef90-4c6b-9ae4-ea00ab3fabb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:17.091820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce174d9-ef90-4c6b-9ae4-ea00ab3fabb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:17.092549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce174d9-ef90-4c6b-9ae4-ea00ab3fabb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:17.094233 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce174d9-ef90-4c6b-9ae4-ea00ab3fabb5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:17.106733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1203/2381] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:17.111174 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1e05e-b9e1-4d0e-bb22-1b32653c51da admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:17.125061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1e05e-b9e1-4d0e-bb22-1b32653c51da admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:17.130232 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56febbfa-422f-4bec-b935-8fc945fed754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:17.130808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56febbfa-422f-4bec-b935-8fc945fed754 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:17.131129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56febbfa-422f-4bec-b935-8fc945fed754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:17.131421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56febbfa-422f-4bec-b935-8fc945fed754 admin admin] PATH_INFO: `/v3/projects/b971a2742a7e4b19ade38208747967bf/users/e3d362aaddea45fb9cdcaba696a3001d/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:17.159428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56febbfa-422f-4bec-b935-8fc945fed754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971a2742a7e4b19ade38208747967bf, user_id=e3d362aaddea45fb9cdcaba696a3001d, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:17.163204 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56febbfa-422f-4bec-b935-8fc945fed754 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:17.187184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1179/2382] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:17 2022] PUT /identity/v3/projects/b971a2742a7e4b19ade38208747967bf/users/e3d362aaddea45fb9cdcaba696a3001d/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:17.191207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce174d9-ef90-4c6b-9ae4-ea00ab3fabb5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:17.201562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce174d9-ef90-4c6b-9ae4-ea00ab3fabb5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:17.243177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:17.259542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b33ad-7815-47e1-856b-c97146cc3053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:17.260176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b33ad-7815-47e1-856b-c97146cc3053 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:17.260446 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b33ad-7815-47e1-856b-c97146cc3053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:17.260710 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b33ad-7815-47e1-856b-c97146cc3053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:17.261359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b33ad-7815-47e1-856b-c97146cc3053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:17.262963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b33ad-7815-47e1-856b-c97146cc3053 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:17.272942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1204/2383] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:17.277280 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56febbfa-422f-4bec-b935-8fc945fed754 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:17.287973 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56febbfa-422f-4bec-b935-8fc945fed754 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:17.293435 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe264adf-02de-4c0a-8116-c4df2b64d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:17.294080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264adf-02de-4c0a-8116-c4df2b64d879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:17.294349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264adf-02de-4c0a-8116-c4df2b64d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:17.294609 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264adf-02de-4c0a-8116-c4df2b64d879 admin admin] PATH_INFO: `/v3/projects/b971a2742a7e4b19ade38208747967bf/users/e3d362aaddea45fb9cdcaba696a3001d/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:17.296760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264adf-02de-4c0a-8116-c4df2b64d879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971a2742a7e4b19ade38208747967bf, user_id=e3d362aaddea45fb9cdcaba696a3001d, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:17.299496 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264adf-02de-4c0a-8116-c4df2b64d879 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:17.309957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1180/2384] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:17 2022] PUT /identity/v3/projects/b971a2742a7e4b19ade38208747967bf/users/e3d362aaddea45fb9cdcaba696a3001d/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:22.601969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b33ad-7815-47e1-856b-c97146cc3053 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:22.613596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b33ad-7815-47e1-856b-c97146cc3053 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:22.681087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:22.681845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:22.682188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:22.682513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] PATH_INFO: `/v3/users/73eb640d956148cdba2721371d728e04` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:22.684262 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73eb640d956148cdba2721371d728e04)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:22.686261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:22.749834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73eb640d956148cdba2721371d728e04'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:22.750851 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73eb640d956148cdba2721371d728e04'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:22.760048 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73eb640d956148cdba2721371d728e04'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:22.776997 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73eb640d956148cdba2721371d728e04'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:22.777836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73eb640d956148cdba2721371d728e04'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:22.804028 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1205/2385] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:22 2022] DELETE /identity/v3/users/73eb640d956148cdba2721371d728e04 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:22.806547 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d31ee-dd5c-4bb2-b258-09d3f79060b5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:22.807023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d31ee-dd5c-4bb2-b258-09d3f79060b5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:22.807108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d31ee-dd5c-4bb2-b258-09d3f79060b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:22.829834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b14d31ee-dd5c-4bb2-b258-09d3f79060b5 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:22.831194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b14d31ee-dd5c-4bb2-b258-09d3f79060b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:23.042749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1181/2386] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:23.075773 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:23.077188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:23.290720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cac5-c49c-40bb-9542-25ad6b0e72d7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:23.307553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a844a8b-ad30-4e4f-8fd8-1a0949cb695f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:23.308215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a844a8b-ad30-4e4f-8fd8-1a0949cb695f service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:23.309187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a844a8b-ad30-4e4f-8fd8-1a0949cb695f service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:23.309187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a844a8b-ad30-4e4f-8fd8-1a0949cb695f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:23.326976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a844a8b-ad30-4e4f-8fd8-1a0949cb695f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:23.328335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a844a8b-ad30-4e4f-8fd8-1a0949cb695f service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:23.353590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1206/2387] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:51:24.194668 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb86d7-14ec-4c23-b762-03f34613b705 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:24.195212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb86d7-14ec-4c23-b762-03f34613b705 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:24.195324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb86d7-14ec-4c23-b762-03f34613b705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:24.241135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-25bb86d7-14ec-4c23-b762-03f34613b705 None None] MFA Rules not processed for user `e3d362aaddea45fb9cdcaba696a3001d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:24.243248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-25bb86d7-14ec-4c23-b762-03f34613b705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:24.322212 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a844a8b-ad30-4e4f-8fd8-1a0949cb695f service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:24.323670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1a844a8b-ad30-4e4f-8fd8-1a0949cb695f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:24.333634 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:24.351957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a844a8b-ad30-4e4f-8fd8-1a0949cb695f service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:24.371896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:24.372872 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:24.373554 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:24.373827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:24.374096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] PATH_INFO: `/v3/projects/5827038eff07474585dafa0c267218cd` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:24.390728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5827038eff07474585dafa0c267218cd)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:24.393249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:24.407510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1182/2388] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:24.428219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb86d7-14ec-4c23-b762-03f34613b705 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:24.430783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-25bb86d7-14ec-4c23-b762-03f34613b705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:24.497375 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5827038eff07474585dafa0c267218cd', 'request_id': 'req-79c31896-9651-4977-8fb6-8d51207f3638'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:24.507190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5827038eff07474585dafa0c267218cd', 'request_id': 'req-79c31896-9651-4977-8fb6-8d51207f3638'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:24.526653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5827038eff07474585dafa0c267218cd', 'request_id': 'req-79c31896-9651-4977-8fb6-8d51207f3638'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:24.562806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] The token cache is being invalidate because project 5827038eff07474585dafa0c267218cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:24.563392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:24.564342 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-79c31896-9651-4977-8fb6-8d51207f3638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:24.566272 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1207/2389] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:24 2022] DELETE /identity/v3/projects/5827038eff07474585dafa0c267218cd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:24.571605 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f146c76-3cd0-4b65-a153-b3a8aa152ef0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:24.572172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f146c76-3cd0-4b65-a153-b3a8aa152ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:24.572961 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f146c76-3cd0-4b65-a153-b3a8aa152ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:24.626127 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9f146c76-3cd0-4b65-a153-b3a8aa152ef0 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:24.628119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9f146c76-3cd0-4b65-a153-b3a8aa152ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:24.656275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb86d7-14ec-4c23-b762-03f34613b705 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:24.761311 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1208/2390] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:24.772229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7615a-f79f-4d94-9753-2397a37e77ab None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:24.772675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7615a-f79f-4d94-9753-2397a37e77ab None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:24.773514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7615a-f79f-4d94-9753-2397a37e77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:24.790354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0c411-4461-44d6-8e44-cabd25f5c7be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:24.791686 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0c411-4461-44d6-8e44-cabd25f5c7be service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:24.793067 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0c411-4461-44d6-8e44-cabd25f5c7be service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:24.793615 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0c411-4461-44d6-8e44-cabd25f5c7be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:24.796311 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6eb0c411-4461-44d6-8e44-cabd25f5c7be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:24.808065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9ae7615a-f79f-4d94-9753-2397a37e77ab None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:24.810140 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9ae7615a-f79f-4d94-9753-2397a37e77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:24.836683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1209/2391] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:24.840513 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7615a-f79f-4d94-9753-2397a37e77ab None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:24.872615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7615a-f79f-4d94-9753-2397a37e77ab None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:24.886211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ad3d6-0bbb-40ed-920a-dd760e587f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:24.886901 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ad3d6-0bbb-40ed-920a-dd760e587f08 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:24.889973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ad3d6-0bbb-40ed-920a-dd760e587f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:24.890527 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ad3d6-0bbb-40ed-920a-dd760e587f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:24.891209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ad3d6-0bbb-40ed-920a-dd760e587f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:24.891512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ad3d6-0bbb-40ed-920a-dd760e587f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:24.893877 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ad3d6-0bbb-40ed-920a-dd760e587f08 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:24.919049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1210/2392] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:24.920639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ad3d6-0bbb-40ed-920a-dd760e587f08 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:24.939128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0c411-4461-44d6-8e44-cabd25f5c7be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:24.941510 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0c411-4461-44d6-8e44-cabd25f5c7be service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:24.957538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ad3d6-0bbb-40ed-920a-dd760e587f08 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:24.958533 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1183/2393] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:51:24.972178 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3ff25-b8b7-48c6-874d-07eb36d4716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:24.972808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ff25-b8b7-48c6-874d-07eb36d4716d admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:24.973098 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ff25-b8b7-48c6-874d-07eb36d4716d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:24.974037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ff25-b8b7-48c6-874d-07eb36d4716d admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:24.974687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3ff25-b8b7-48c6-874d-07eb36d4716d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:24.976675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3ff25-b8b7-48c6-874d-07eb36d4716d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.043410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1211/2394] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:24 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:25.043659 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0c411-4461-44d6-8e44-cabd25f5c7be service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:25.056356 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0c411-4461-44d6-8e44-cabd25f5c7be service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:25.111687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:25.160642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303a4c6-6f93-477e-93ea-0ec02371de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:25.161622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303a4c6-6f93-477e-93ea-0ec02371de7d admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.161776 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303a4c6-6f93-477e-93ea-0ec02371de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.162030 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303a4c6-6f93-477e-93ea-0ec02371de7d admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.162802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303a4c6-6f93-477e-93ea-0ec02371de7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:25.165107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303a4c6-6f93-477e-93ea-0ec02371de7d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.200066 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1184/2395] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:25 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:25.204373 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3ff25-b8b7-48c6-874d-07eb36d4716d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:25.217707 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3ff25-b8b7-48c6-874d-07eb36d4716d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:25.229695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33e990-e4d8-42b9-ab8a-bfcf0a019455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:25.230413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33e990-e4d8-42b9-ab8a-bfcf0a019455 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.230692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33e990-e4d8-42b9-ab8a-bfcf0a019455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.231019 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33e990-e4d8-42b9-ab8a-bfcf0a019455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.232731 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33e990-e4d8-42b9-ab8a-bfcf0a019455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:25.234401 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33e990-e4d8-42b9-ab8a-bfcf0a019455 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.254058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1212/2396] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:25.258005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303a4c6-6f93-477e-93ea-0ec02371de7d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:25.273355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303a4c6-6f93-477e-93ea-0ec02371de7d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:25.279806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1976d6a-fa17-45e0-9576-40f0943852d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:25.281172 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1976d6a-fa17-45e0-9576-40f0943852d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.281785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1976d6a-fa17-45e0-9576-40f0943852d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.282761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1976d6a-fa17-45e0-9576-40f0943852d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.283623 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1976d6a-fa17-45e0-9576-40f0943852d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:25.287082 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1976d6a-fa17-45e0-9576-40f0943852d0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.309495 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1185/2397] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:25.313827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33e990-e4d8-42b9-ab8a-bfcf0a019455 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:25.334729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33e990-e4d8-42b9-ab8a-bfcf0a019455 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:25.342409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83323d-7fea-44d6-8200-9820f4459610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:25.343118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83323d-7fea-44d6-8200-9820f4459610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.343392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83323d-7fea-44d6-8200-9820f4459610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.343660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83323d-7fea-44d6-8200-9820f4459610 admin admin] PATH_INFO: `/v3/projects/cd25694014cc47da8d622e4e4c94a024/users/f5c26f5e80b44245a59f817003c98742/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.366164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83323d-7fea-44d6-8200-9820f4459610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd25694014cc47da8d622e4e4c94a024, user_id=f5c26f5e80b44245a59f817003c98742, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:25.372126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83323d-7fea-44d6-8200-9820f4459610 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.395821 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1213/2398] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:25 2022] PUT /identity/v3/projects/cd25694014cc47da8d622e4e4c94a024/users/f5c26f5e80b44245a59f817003c98742/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:25.406829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2c64-9d82-41c6-a83c-0a7007f36439 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.407158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2c64-9d82-41c6-a83c-0a7007f36439 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.407444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2c64-9d82-41c6-a83c-0a7007f36439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.440120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-865a2c64-9d82-41c6-a83c-0a7007f36439 None None] MFA Rules not processed for user `f5c26f5e80b44245a59f817003c98742`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:25.443009 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-865a2c64-9d82-41c6-a83c-0a7007f36439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:25.534351 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1186/2399] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:25.539449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83323d-7fea-44d6-8200-9820f4459610 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:25.556697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:25.641195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83323d-7fea-44d6-8200-9820f4459610 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:25.646433 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773c3b8-b736-4fd8-837c-91d8f2d21129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:25.647072 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773c3b8-b736-4fd8-837c-91d8f2d21129 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.647346 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773c3b8-b736-4fd8-837c-91d8f2d21129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.647609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773c3b8-b736-4fd8-837c-91d8f2d21129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.648296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773c3b8-b736-4fd8-837c-91d8f2d21129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:25.650328 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773c3b8-b736-4fd8-837c-91d8f2d21129 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.682909 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1214/2400] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:25 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:25.687731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a2c64-9d82-41c6-a83c-0a7007f36439 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:25.700284 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a2c64-9d82-41c6-a83c-0a7007f36439 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:25.769894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb580714-2a9c-452c-b019-67e1a2ab0b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:25.770519 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb580714-2a9c-452c-b019-67e1a2ab0b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.770794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb580714-2a9c-452c-b019-67e1a2ab0b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.771101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb580714-2a9c-452c-b019-67e1a2ab0b19 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.771740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb580714-2a9c-452c-b019-67e1a2ab0b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:25.773673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb580714-2a9c-452c-b019-67e1a2ab0b19 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.800457 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1187/2401] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:25 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:25.801618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773c3b8-b736-4fd8-837c-91d8f2d21129 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:25.812692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773c3b8-b736-4fd8-837c-91d8f2d21129 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:25.817440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd046-140e-4f93-8b09-3d9b4dd878b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:25.818054 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd046-140e-4f93-8b09-3d9b4dd878b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.818330 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd046-140e-4f93-8b09-3d9b4dd878b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.818601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd046-140e-4f93-8b09-3d9b4dd878b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.819279 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cd046-140e-4f93-8b09-3d9b4dd878b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:25.820932 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cd046-140e-4f93-8b09-3d9b4dd878b8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.832585 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1215/2402] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:25.836957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb580714-2a9c-452c-b019-67e1a2ab0b19 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:25.848152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb580714-2a9c-452c-b019-67e1a2ab0b19 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:25.853430 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09b8f4-5b3b-495b-9874-2807c83e0391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:25.854032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09b8f4-5b3b-495b-9874-2807c83e0391 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.854309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09b8f4-5b3b-495b-9874-2807c83e0391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.854633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09b8f4-5b3b-495b-9874-2807c83e0391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.855320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09b8f4-5b3b-495b-9874-2807c83e0391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:25.856953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09b8f4-5b3b-495b-9874-2807c83e0391 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.867907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1188/2403] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:25.872752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd046-140e-4f93-8b09-3d9b4dd878b8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:25.883578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd046-140e-4f93-8b09-3d9b4dd878b8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:25.888938 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6f60-0482-468e-95a4-5154267624de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:25.889593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6f60-0482-468e-95a4-5154267624de admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.889867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6f60-0482-468e-95a4-5154267624de admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.890136 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6f60-0482-468e-95a4-5154267624de admin admin] PATH_INFO: `/v3/projects/b9cb35987c5e4d1286c3724320922bf7/users/2bdeaa3f29d746f8a8fc01c334772624/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.906289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d6f60-0482-468e-95a4-5154267624de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cb35987c5e4d1286c3724320922bf7, user_id=2bdeaa3f29d746f8a8fc01c334772624, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:25.909003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d6f60-0482-468e-95a4-5154267624de admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:25.927022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1216/2404] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:25 2022] PUT /identity/v3/projects/b9cb35987c5e4d1286c3724320922bf7/users/2bdeaa3f29d746f8a8fc01c334772624/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:25.937190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb4e76-a2be-4f1e-add9-43549518f51d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:25.937631 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb4e76-a2be-4f1e-add9-43549518f51d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:25.937824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb4e76-a2be-4f1e-add9-43549518f51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:25.961404 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:25.971239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8fbb4e76-a2be-4f1e-add9-43549518f51d None None] MFA Rules not processed for user `2bdeaa3f29d746f8a8fc01c334772624`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:25.972745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8fbb4e76-a2be-4f1e-add9-43549518f51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:26.044603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1189/2405] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:26.049224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6f60-0482-468e-95a4-5154267624de admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:26.113139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6f60-0482-468e-95a4-5154267624de admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:26.117749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560268c-90e2-4d5f-a73b-225dccd9d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:26.118347 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560268c-90e2-4d5f-a73b-225dccd9d0be admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:26.118615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560268c-90e2-4d5f-a73b-225dccd9d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:26.118881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560268c-90e2-4d5f-a73b-225dccd9d0be admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:26.119551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560268c-90e2-4d5f-a73b-225dccd9d0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:26.121659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560268c-90e2-4d5f-a73b-225dccd9d0be admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:26.154611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1217/2406] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:26 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:26.159246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb4e76-a2be-4f1e-add9-43549518f51d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:26.171044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb4e76-a2be-4f1e-add9-43549518f51d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:26.230275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65b83d-3de3-4850-aa0a-91df7f10b277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:26.230997 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b83d-3de3-4850-aa0a-91df7f10b277 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:26.231251 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b83d-3de3-4850-aa0a-91df7f10b277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:26.231487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b83d-3de3-4850-aa0a-91df7f10b277 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:26.232276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65b83d-3de3-4850-aa0a-91df7f10b277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:26.234151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65b83d-3de3-4850-aa0a-91df7f10b277 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:26.254235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99740-de40-43ae-a669-b619a3b62098 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:26.254515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99740-de40-43ae-a669-b619a3b62098 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:26.254804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99740-de40-43ae-a669-b619a3b62098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:26.258373 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1190/2407] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:26 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:26.262133 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65b83d-3de3-4850-aa0a-91df7f10b277 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:26.272121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65b83d-3de3-4850-aa0a-91df7f10b277 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:26.274142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-35f99740-de40-43ae-a669-b619a3b62098 None None] MFA Rules not processed for user `6b81558d71f84856b9fb079f88158896`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:26.275379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-35f99740-de40-43ae-a669-b619a3b62098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:26.276711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc66b29-f69e-4c71-8600-0402c341e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:26.277301 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc66b29-f69e-4c71-8600-0402c341e190 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:26.277571 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc66b29-f69e-4c71-8600-0402c341e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:26.277838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc66b29-f69e-4c71-8600-0402c341e190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:26.278467 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc66b29-f69e-4c71-8600-0402c341e190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:26.280121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc66b29-f69e-4c71-8600-0402c341e190 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:26.293126 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1191/2408] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:26.294111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc66b29-f69e-4c71-8600-0402c341e190 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:26.304293 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc66b29-f69e-4c71-8600-0402c341e190 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:26.309617 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526cde-3a3f-4c50-b281-88540ef93efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:26.310302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526cde-3a3f-4c50-b281-88540ef93efc admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:26.310578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526cde-3a3f-4c50-b281-88540ef93efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:26.310846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526cde-3a3f-4c50-b281-88540ef93efc admin admin] PATH_INFO: `/v3/projects/9d22859b31f44985ba48ddc0323f98fb/users/c21fc3c2cb0540f7809cbead5d08bce2/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:26.316558 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:26.328603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526cde-3a3f-4c50-b281-88540ef93efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d22859b31f44985ba48ddc0323f98fb, user_id=c21fc3c2cb0540f7809cbead5d08bce2, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:26.331408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526cde-3a3f-4c50-b281-88540ef93efc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:26.336704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1218/2409] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:26.356539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1192/2410] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:26 2022] PUT /identity/v3/projects/9d22859b31f44985ba48ddc0323f98fb/users/c21fc3c2cb0540f7809cbead5d08bce2/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:26.418886 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f99740-de40-43ae-a669-b619a3b62098 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:26.431545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f99740-de40-43ae-a669-b619a3b62098 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:26.495999 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc72a18-57e5-44ef-86b9-f73004072122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:26.496700 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72a18-57e5-44ef-86b9-f73004072122 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:26.497039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72a18-57e5-44ef-86b9-f73004072122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:26.497404 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72a18-57e5-44ef-86b9-f73004072122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:26.498224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc72a18-57e5-44ef-86b9-f73004072122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:26.499926 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc72a18-57e5-44ef-86b9-f73004072122 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:26.515696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1219/2411] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:26.516624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526cde-3a3f-4c50-b281-88540ef93efc admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:26.532584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526cde-3a3f-4c50-b281-88540ef93efc admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:26.537148 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315346c-34df-487a-9b60-5fac48efa0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:26.537884 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315346c-34df-487a-9b60-5fac48efa0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:26.538493 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315346c-34df-487a-9b60-5fac48efa0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:26.538593 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315346c-34df-487a-9b60-5fac48efa0e2 admin admin] PATH_INFO: `/v3/projects/9d22859b31f44985ba48ddc0323f98fb/users/c21fc3c2cb0540f7809cbead5d08bce2/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:26.540899 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315346c-34df-487a-9b60-5fac48efa0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d22859b31f44985ba48ddc0323f98fb, user_id=c21fc3c2cb0540f7809cbead5d08bce2, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:26.544136 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315346c-34df-487a-9b60-5fac48efa0e2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:26.565962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1193/2412] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:26 2022] PUT /identity/v3/projects/9d22859b31f44985ba48ddc0323f98fb/users/c21fc3c2cb0540f7809cbead5d08bce2/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:26.566917 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5895-154e-4bda-90ec-9fab9f764dd5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:26.567238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5895-154e-4bda-90ec-9fab9f764dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:26.567503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5895-154e-4bda-90ec-9fab9f764dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:26.608489 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8ffa5895-154e-4bda-90ec-9fab9f764dd5 None None] MFA Rules not processed for user `c21fc3c2cb0540f7809cbead5d08bce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:26.610905 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8ffa5895-154e-4bda-90ec-9fab9f764dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:26.704720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1220/2413] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:26.730372 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315346c-34df-487a-9b60-5fac48efa0e2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:26.732550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2315346c-34df-487a-9b60-5fac48efa0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:26.797835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:26.814456 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315346c-34df-487a-9b60-5fac48efa0e2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:26.831671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41ea24-bde6-47d6-b569-16b898a5816b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:26.831671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ea24-bde6-47d6-b569-16b898a5816b service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:26.831671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ea24-bde6-47d6-b569-16b898a5816b service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:26.831671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ea24-bde6-47d6-b569-16b898a5816b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:26.917738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41ea24-bde6-47d6-b569-16b898a5816b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:26.919424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41ea24-bde6-47d6-b569-16b898a5816b service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:26.933689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1194/2414] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:28.296810 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5895-154e-4bda-90ec-9fab9f764dd5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:28.298259 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8ffa5895-154e-4bda-90ec-9fab9f764dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:28.403155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5895-154e-4bda-90ec-9fab9f764dd5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:28.406717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cbb58-93b7-48ee-9483-856902a772ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:28.407352 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cbb58-93b7-48ee-9483-856902a772ae service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:28.407723 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cbb58-93b7-48ee-9483-856902a772ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:28.407985 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cbb58-93b7-48ee-9483-856902a772ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:28.409803 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-907cbb58-93b7-48ee-9483-856902a772ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:28.435783 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:28.486698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cbb58-93b7-48ee-9483-856902a772ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:28.488300 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cbb58-93b7-48ee-9483-856902a772ae service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:28.499471 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1221/2415] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:28.779104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41ea24-bde6-47d6-b569-16b898a5816b service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:28.780650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1a41ea24-bde6-47d6-b569-16b898a5816b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:28.793487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41ea24-bde6-47d6-b569-16b898a5816b service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:28.798303 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a5117-6c91-478d-b0d5-36f4fd009872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:28.798993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a5117-6c91-478d-b0d5-36f4fd009872 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:28.799275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a5117-6c91-478d-b0d5-36f4fd009872 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:28.799756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a5117-6c91-478d-b0d5-36f4fd009872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:28.906299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a5117-6c91-478d-b0d5-36f4fd009872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:28.907801 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a5117-6c91-478d-b0d5-36f4fd009872 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:28.925168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1195/2416] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:29.051405 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6e4e-03f0-4f4b-a626-c98e3890e521 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:29.051699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6e4e-03f0-4f4b-a626-c98e3890e521 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:29.051955 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6e4e-03f0-4f4b-a626-c98e3890e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:29.076776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-91ef6e4e-03f0-4f4b-a626-c98e3890e521 None None] MFA Rules not processed for user `cbb2c47aefed45f3abfc8919693aa61b`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:29.078224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-91ef6e4e-03f0-4f4b-a626-c98e3890e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:29.204068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1222/2417] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:29.696493 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a5117-6c91-478d-b0d5-36f4fd009872 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:29.706153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a5117-6c91-478d-b0d5-36f4fd009872 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:29.710202 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13342c0d-a629-45ae-b00f-73be251e2897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:29.711003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13342c0d-a629-45ae-b00f-73be251e2897 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:29.711269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13342c0d-a629-45ae-b00f-73be251e2897 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:29.711539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13342c0d-a629-45ae-b00f-73be251e2897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:29.721412 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13342c0d-a629-45ae-b00f-73be251e2897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:29.723258 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13342c0d-a629-45ae-b00f-73be251e2897 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:29.735135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1196/2418] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:33.264737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef6e4e-03f0-4f4b-a626-c98e3890e521 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:33.266752 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-91ef6e4e-03f0-4f4b-a626-c98e3890e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:33.287196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef6e4e-03f0-4f4b-a626-c98e3890e521 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:33.300916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:33.301894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:33.302549 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:33.303022 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] PATH_INFO: `/v3/users/79a2780405ee4b77a63166819c3da789` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:33.304483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a2780405ee4b77a63166819c3da789)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:33.308495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:33.397812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a2780405ee4b77a63166819c3da789'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.398615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a2780405ee4b77a63166819c3da789'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.406808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a2780405ee4b77a63166819c3da789'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.420776 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a2780405ee4b77a63166819c3da789'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.421609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b8e1330d-c498-4a77-b870-0d2a0893ee2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a2780405ee4b77a63166819c3da789'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.436758 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1223/2419] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:33 2022] DELETE /identity/v3/users/79a2780405ee4b77a63166819c3da789 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:33.656310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13342c0d-a629-45ae-b00f-73be251e2897 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:33.675315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13342c0d-a629-45ae-b00f-73be251e2897 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:33.745728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:33.746347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:33.746621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:33.747102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] PATH_INFO: `/v3/projects/37c19412bdd84967be4262a059299ae7` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:33.748218 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c19412bdd84967be4262a059299ae7)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:33.750325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:33.775464 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:33.802064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c19412bdd84967be4262a059299ae7', 'request_id': 'req-5a0bad79-8332-4588-848f-ce65795c2a09'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.808485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c19412bdd84967be4262a059299ae7', 'request_id': 'req-5a0bad79-8332-4588-848f-ce65795c2a09'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.814590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c19412bdd84967be4262a059299ae7', 'request_id': 'req-5a0bad79-8332-4588-848f-ce65795c2a09'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.829145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] The token cache is being invalidate because project 37c19412bdd84967be4262a059299ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:33.829145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.829721 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5a0bad79-8332-4588-848f-ce65795c2a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:33.831550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1197/2420] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:33 2022] DELETE /identity/v3/projects/37c19412bdd84967be4262a059299ae7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:33.836367 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11343273-a4ea-4f3a-8477-d14efe500492 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:33.836648 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11343273-a4ea-4f3a-8477-d14efe500492 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:33.836920 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11343273-a4ea-4f3a-8477-d14efe500492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:33.864949 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-11343273-a4ea-4f3a-8477-d14efe500492 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:33.866114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-11343273-a4ea-4f3a-8477-d14efe500492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:33.913598 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:33.944199 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1224/2421] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:33.952389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1167-5ddc-466b-b5ee-c4276498d8bb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:33.952728 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1167-5ddc-466b-b5ee-c4276498d8bb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:33.953099 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1167-5ddc-466b-b5ee-c4276498d8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:33.976738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f49f1167-5ddc-466b-b5ee-c4276498d8bb None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:33.978121 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f49f1167-5ddc-466b-b5ee-c4276498d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:33.987051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1198/2422] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:33.991760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11343273-a4ea-4f3a-8477-d14efe500492 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:34.006791 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11343273-a4ea-4f3a-8477-d14efe500492 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:34.012496 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8efad8-f645-4220-ba20-9d525c3031ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:34.013109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8efad8-f645-4220-ba20-9d525c3031ee admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.013380 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8efad8-f645-4220-ba20-9d525c3031ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.013647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8efad8-f645-4220-ba20-9d525c3031ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.014284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8efad8-f645-4220-ba20-9d525c3031ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:34.014577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8efad8-f645-4220-ba20-9d525c3031ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:34.016287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8efad8-f645-4220-ba20-9d525c3031ee admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:34.030975 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1225/2423] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:34.033468 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f1167-5ddc-466b-b5ee-c4276498d8bb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:34.047898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f1167-5ddc-466b-b5ee-c4276498d8bb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:34.052656 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8d60f-0eed-4486-9be5-d38c7f2fbdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:34.053249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8d60f-0eed-4486-9be5-d38c7f2fbdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.053516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8d60f-0eed-4486-9be5-d38c7f2fbdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.053777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8d60f-0eed-4486-9be5-d38c7f2fbdb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.054410 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8d60f-0eed-4486-9be5-d38c7f2fbdb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:34.056340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8d60f-0eed-4486-9be5-d38c7f2fbdb5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:34.090047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1199/2424] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:34 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:34.094338 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8efad8-f645-4220-ba20-9d525c3031ee admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:34.104976 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8efad8-f645-4220-ba20-9d525c3031ee admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:34.164913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab13e62-bd99-4068-b491-db57f661f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:34.165543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab13e62-bd99-4068-b491-db57f661f7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.165796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab13e62-bd99-4068-b491-db57f661f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.166068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab13e62-bd99-4068-b491-db57f661f7ba admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.166691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab13e62-bd99-4068-b491-db57f661f7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:34.168638 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab13e62-bd99-4068-b491-db57f661f7ba admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:34.193014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1226/2425] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:34 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:34.197445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8d60f-0eed-4486-9be5-d38c7f2fbdb5 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:34.208545 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8d60f-0eed-4486-9be5-d38c7f2fbdb5 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:34.213566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4f432-ceb7-445c-8717-1ecac8222ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:34.214155 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4f432-ceb7-445c-8717-1ecac8222ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.214433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4f432-ceb7-445c-8717-1ecac8222ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.214702 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4f432-ceb7-445c-8717-1ecac8222ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.215377 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4f432-ceb7-445c-8717-1ecac8222ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:34.216970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4f432-ceb7-445c-8717-1ecac8222ec2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:34.227088 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1200/2426] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:34.231040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab13e62-bd99-4068-b491-db57f661f7ba admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:34.242426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab13e62-bd99-4068-b491-db57f661f7ba admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:34.247712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace74ba-7ab6-408d-b5db-40f8efe8f5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:34.248334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace74ba-7ab6-408d-b5db-40f8efe8f5df admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.248616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace74ba-7ab6-408d-b5db-40f8efe8f5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.248881 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace74ba-7ab6-408d-b5db-40f8efe8f5df admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.249529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace74ba-7ab6-408d-b5db-40f8efe8f5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:34.251207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace74ba-7ab6-408d-b5db-40f8efe8f5df admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:34.265168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1227/2427] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:34.269599 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4f432-ceb7-445c-8717-1ecac8222ec2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:34.280224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4f432-ceb7-445c-8717-1ecac8222ec2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:34.285337 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59395232-e976-4dc6-8936-4c9127d141fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:34.285978 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395232-e976-4dc6-8936-4c9127d141fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.286252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395232-e976-4dc6-8936-4c9127d141fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.286518 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395232-e976-4dc6-8936-4c9127d141fb admin admin] PATH_INFO: `/v3/projects/8debaf97ac8f4ef8940dfb9ba858a5b4/users/b2ef1a82e75648afb8bd76da21158a4e/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.302091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59395232-e976-4dc6-8936-4c9127d141fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8debaf97ac8f4ef8940dfb9ba858a5b4, user_id=b2ef1a82e75648afb8bd76da21158a4e, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:34.304752 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59395232-e976-4dc6-8936-4c9127d141fb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:34.320951 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1201/2428] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:34 2022] PUT /identity/v3/projects/8debaf97ac8f4ef8940dfb9ba858a5b4/users/b2ef1a82e75648afb8bd76da21158a4e/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:34.331495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cabb28-2eb6-4ea3-b126-1a7d7850776d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.331852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cabb28-2eb6-4ea3-b126-1a7d7850776d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.332213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cabb28-2eb6-4ea3-b126-1a7d7850776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.364627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-83cabb28-2eb6-4ea3-b126-1a7d7850776d None None] MFA Rules not processed for user `b2ef1a82e75648afb8bd76da21158a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:34.365871 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-83cabb28-2eb6-4ea3-b126-1a7d7850776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:34.399027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59395232-e976-4dc6-8936-4c9127d141fb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:34.400840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-59395232-e976-4dc6-8936-4c9127d141fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:34.437935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1228/2429] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:34.451146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cabb28-2eb6-4ea3-b126-1a7d7850776d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:34.452654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-83cabb28-2eb6-4ea3-b126-1a7d7850776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:34.479348 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59395232-e976-4dc6-8936-4c9127d141fb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:34.483985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:34.484636 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.484893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.485165 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] PATH_INFO: `/v3/users/f5c26f5e80b44245a59f817003c98742` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.486438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c26f5e80b44245a59f817003c98742)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:34.486849 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:34.488909 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:34.527748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cabb28-2eb6-4ea3-b126-1a7d7850776d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:34.533552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffc1d1-62b4-4723-bd16-feb2eff68e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:34.534156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffc1d1-62b4-4723-bd16-feb2eff68e36 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.534572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffc1d1-62b4-4723-bd16-feb2eff68e36 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.534874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffc1d1-62b4-4723-bd16-feb2eff68e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.539815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c26f5e80b44245a59f817003c98742'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:34.540478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c26f5e80b44245a59f817003c98742'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:34.542577 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:34.543049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffc1d1-62b4-4723-bd16-feb2eff68e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:34.544724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffc1d1-62b4-4723-bd16-feb2eff68e36 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:34.548621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c26f5e80b44245a59f817003c98742'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:34.555218 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1229/2430] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:34.563157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c26f5e80b44245a59f817003c98742'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:34.563867 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c26f5e80b44245a59f817003c98742'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:34.579027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1202/2431] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:34 2022] DELETE /identity/v3/users/f5c26f5e80b44245a59f817003c98742 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:34.584126 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86275-5f79-4a1e-ae7e-52ad11902831 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.584438 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86275-5f79-4a1e-ae7e-52ad11902831 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.584715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86275-5f79-4a1e-ae7e-52ad11902831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.604174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ecd86275-5f79-4a1e-ae7e-52ad11902831 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:34.605387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ecd86275-5f79-4a1e-ae7e-52ad11902831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:34.679925 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1230/2432] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:34.689819 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:34.691487 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:34.749991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeba9d8-84c8-4a75-828b-fef54019f378 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:34.754711 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f372aa1-e63d-42f5-a5ac-71b4e796fe22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:34.755360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f372aa1-e63d-42f5-a5ac-71b4e796fe22 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:34.755620 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f372aa1-e63d-42f5-a5ac-71b4e796fe22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:34.755887 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f372aa1-e63d-42f5-a5ac-71b4e796fe22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:34.765418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f372aa1-e63d-42f5-a5ac-71b4e796fe22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:34.766845 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f372aa1-e63d-42f5-a5ac-71b4e796fe22 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:34.776798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1203/2433] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:35.087635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd86275-5f79-4a1e-ae7e-52ad11902831 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:35.089350 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ecd86275-5f79-4a1e-ae7e-52ad11902831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:35.101449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd86275-5f79-4a1e-ae7e-52ad11902831 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:35.106534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:35.107087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:35.107420 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:35.107747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] PATH_INFO: `/v3/projects/cd25694014cc47da8d622e4e4c94a024` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:35.108984 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd25694014cc47da8d622e4e4c94a024)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:35.110993 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:35.162209 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd25694014cc47da8d622e4e4c94a024', 'request_id': 'req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.168014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd25694014cc47da8d622e4e4c94a024', 'request_id': 'req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.174548 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd25694014cc47da8d622e4e4c94a024', 'request_id': 'req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.188867 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] The token cache is being invalidate because project cd25694014cc47da8d622e4e4c94a024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:35.189109 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.189792 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.191805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1231/2434] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:35 2022] DELETE /identity/v3/projects/cd25694014cc47da8d622e4e4c94a024 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:35.196040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f372aa1-e63d-42f5-a5ac-71b4e796fe22 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:35.206706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f372aa1-e63d-42f5-a5ac-71b4e796fe22 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:35.265020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:35.265697 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:35.265967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:35.266230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] PATH_INFO: `/v3/users/2bdeaa3f29d746f8a8fc01c334772624` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:35.267381 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bdeaa3f29d746f8a8fc01c334772624)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:35.270281 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:35.339562 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bdeaa3f29d746f8a8fc01c334772624'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.340256 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bdeaa3f29d746f8a8fc01c334772624'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.350022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bdeaa3f29d746f8a8fc01c334772624'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.365830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:35.367516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bdeaa3f29d746f8a8fc01c334772624'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.368461 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bdeaa3f29d746f8a8fc01c334772624'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.392072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1204/2435] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:35 2022] DELETE /identity/v3/users/2bdeaa3f29d746f8a8fc01c334772624 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:35.701606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:35.703180 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:35.723798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3fc17-f9af-4b83-a98f-bcfbf6e45f09 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:35.785883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:35.804935 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:35.805565 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:35.805839 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:35.806202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] PATH_INFO: `/v3/projects/b9cb35987c5e4d1286c3724320922bf7` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:35.807340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cb35987c5e4d1286c3724320922bf7)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:35.809265 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:35.859833 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cb35987c5e4d1286c3724320922bf7', 'request_id': 'req-bda54442-b501-4a69-a137-9cb80bd978b0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.865960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cb35987c5e4d1286c3724320922bf7', 'request_id': 'req-bda54442-b501-4a69-a137-9cb80bd978b0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.873001 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cb35987c5e4d1286c3724320922bf7', 'request_id': 'req-bda54442-b501-4a69-a137-9cb80bd978b0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.890281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] The token cache is being invalidate because project b9cb35987c5e4d1286c3724320922bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:35.890571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.891289 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:35.892840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1232/2436] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:35 2022] DELETE /identity/v3/projects/b9cb35987c5e4d1286c3724320922bf7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:35.897132 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:35.898600 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:35.911900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60570a-c334-4718-ad77-21f7f51e708f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:35.969944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:35.970563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:35.970841 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:35.971145 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] PATH_INFO: `/v3/users/c21fc3c2cb0540f7809cbead5d08bce2` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:35.972549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21fc3c2cb0540f7809cbead5d08bce2)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:35.974466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:36.025194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21fc3c2cb0540f7809cbead5d08bce2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.025856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21fc3c2cb0540f7809cbead5d08bce2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.033058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21fc3c2cb0540f7809cbead5d08bce2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.045832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21fc3c2cb0540f7809cbead5d08bce2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.046511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f2a50c50-a46c-4c2a-ae5f-ccfc70907416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21fc3c2cb0540f7809cbead5d08bce2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.072800 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1205/2437] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:35 2022] DELETE /identity/v3/users/c21fc3c2cb0540f7809cbead5d08bce2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:36.580631 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:36.582349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:36.596834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda54442-b501-4a69-a137-9cb80bd978b0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:36.680808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:36.681448 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:36.681717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:36.681981 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] PATH_INFO: `/v3/projects/9d22859b31f44985ba48ddc0323f98fb` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:36.683119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d22859b31f44985ba48ddc0323f98fb)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:36.685017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:36.735765 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d22859b31f44985ba48ddc0323f98fb', 'request_id': 'req-fd6ccff0-7de5-44f2-805d-f3791974d320'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.742898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d22859b31f44985ba48ddc0323f98fb', 'request_id': 'req-fd6ccff0-7de5-44f2-805d-f3791974d320'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.752641 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d22859b31f44985ba48ddc0323f98fb', 'request_id': 'req-fd6ccff0-7de5-44f2-805d-f3791974d320'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.774161 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] The token cache is being invalidate because project 9d22859b31f44985ba48ddc0323f98fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:36.774483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.776500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fd6ccff0-7de5-44f2-805d-f3791974d320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:36.783015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1233/2438] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:36 2022] DELETE /identity/v3/projects/9d22859b31f44985ba48ddc0323f98fb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:36.784983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7665d-2d8b-4be8-83c8-587d4de0f258 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:36.785259 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7665d-2d8b-4be8-83c8-587d4de0f258 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:36.786539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7665d-2d8b-4be8-83c8-587d4de0f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:36.813808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-68a7665d-2d8b-4be8-83c8-587d4de0f258 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:36.815853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-68a7665d-2d8b-4be8-83c8-587d4de0f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:36.896058 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1206/2439] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:36.904075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105cac4-5592-46bf-91d8-0874d96177bd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:36.904354 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105cac4-5592-46bf-91d8-0874d96177bd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:36.904623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105cac4-5592-46bf-91d8-0874d96177bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:36.912424 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:36.925853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a105cac4-5592-46bf-91d8-0874d96177bd None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:36.927107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a105cac4-5592-46bf-91d8-0874d96177bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:36.934888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1234/2440] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:36.939299 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7665d-2d8b-4be8-83c8-587d4de0f258 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:36.949341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7665d-2d8b-4be8-83c8-587d4de0f258 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:36.955428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe007d3-2e80-4189-90a2-de1f15887340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:36.956027 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe007d3-2e80-4189-90a2-de1f15887340 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:36.956454 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe007d3-2e80-4189-90a2-de1f15887340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:36.956729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe007d3-2e80-4189-90a2-de1f15887340 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:36.957400 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe007d3-2e80-4189-90a2-de1f15887340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:36.957701 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe007d3-2e80-4189-90a2-de1f15887340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:36.959355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe007d3-2e80-4189-90a2-de1f15887340 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:36.961832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:36.973996 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1207/2441] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:36.978725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105cac4-5592-46bf-91d8-0874d96177bd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:36.991684 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105cac4-5592-46bf-91d8-0874d96177bd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:36.996442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061ed35-43ff-40c8-9136-37130862e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:36.997037 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061ed35-43ff-40c8-9136-37130862e3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:36.997310 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061ed35-43ff-40c8-9136-37130862e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:36.997570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061ed35-43ff-40c8-9136-37130862e3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:36.998201 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061ed35-43ff-40c8-9136-37130862e3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:37.000164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061ed35-43ff-40c8-9136-37130862e3a9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:37.029409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1235/2442] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:36 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:37.034035 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe007d3-2e80-4189-90a2-de1f15887340 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:37.045256 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe007d3-2e80-4189-90a2-de1f15887340 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:37.103903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8d761-1a6c-4df7-bbea-9c3e45c4d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:37.104539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8d761-1a6c-4df7-bbea-9c3e45c4d0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:37.104804 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8d761-1a6c-4df7-bbea-9c3e45c4d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:37.105084 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8d761-1a6c-4df7-bbea-9c3e45c4d0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:37.105720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8d761-1a6c-4df7-bbea-9c3e45c4d0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:37.107707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8d761-1a6c-4df7-bbea-9c3e45c4d0c6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:37.131549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1208/2443] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:37 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:37.135786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061ed35-43ff-40c8-9136-37130862e3a9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:37.146583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061ed35-43ff-40c8-9136-37130862e3a9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:37.151902 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115a09d-8a8e-4ade-b2ff-2ee1e901a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:37.152509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a09d-8a8e-4ade-b2ff-2ee1e901a5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:37.152782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a09d-8a8e-4ade-b2ff-2ee1e901a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:37.153041 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a09d-8a8e-4ade-b2ff-2ee1e901a5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:37.153676 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115a09d-8a8e-4ade-b2ff-2ee1e901a5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:37.155318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115a09d-8a8e-4ade-b2ff-2ee1e901a5fb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:37.166172 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1236/2444] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:37.170313 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8d761-1a6c-4df7-bbea-9c3e45c4d0c6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:37.180618 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8d761-1a6c-4df7-bbea-9c3e45c4d0c6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:37.185835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f352-6792-43d4-a284-fc579c5e5fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:37.186349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f352-6792-43d4-a284-fc579c5e5fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:37.186630 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f352-6792-43d4-a284-fc579c5e5fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:37.186888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f352-6792-43d4-a284-fc579c5e5fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:37.187560 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f352-6792-43d4-a284-fc579c5e5fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:37.189152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f352-6792-43d4-a284-fc579c5e5fe4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:37.200572 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1209/2445] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:37.204693 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115a09d-8a8e-4ade-b2ff-2ee1e901a5fb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:37.215190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115a09d-8a8e-4ade-b2ff-2ee1e901a5fb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:37.219859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a86ad-6ea2-4658-8227-302fa3ab18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:37.220514 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a86ad-6ea2-4658-8227-302fa3ab18d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:37.220854 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a86ad-6ea2-4658-8227-302fa3ab18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:37.221141 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a86ad-6ea2-4658-8227-302fa3ab18d6 admin admin] PATH_INFO: `/v3/projects/99d85806fe4c4c64a6933afb3d3eeb70/users/631587c2f37148409c63707a5f77a8d2/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:37.236004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a86ad-6ea2-4658-8227-302fa3ab18d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d85806fe4c4c64a6933afb3d3eeb70, user_id=631587c2f37148409c63707a5f77a8d2, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:37.238800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a86ad-6ea2-4658-8227-302fa3ab18d6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:37.255353 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1237/2446] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:37 2022] PUT /identity/v3/projects/99d85806fe4c4c64a6933afb3d3eeb70/users/631587c2f37148409c63707a5f77a8d2/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:37.267877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee6bea-30a8-4e21-a5be-ebd3df9dddaf None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:37.268249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee6bea-30a8-4e21-a5be-ebd3df9dddaf None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:37.268680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee6bea-30a8-4e21-a5be-ebd3df9dddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:37.300903 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-caee6bea-30a8-4e21-a5be-ebd3df9dddaf None None] MFA Rules not processed for user `631587c2f37148409c63707a5f77a8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:37.302199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-caee6bea-30a8-4e21-a5be-ebd3df9dddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:37.368051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1210/2447] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:37.380816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a86ad-6ea2-4658-8227-302fa3ab18d6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:37.383146 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-250a86ad-6ea2-4658-8227-302fa3ab18d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:37.441500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a86ad-6ea2-4658-8227-302fa3ab18d6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:37.446251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366239f-75ce-40eb-905e-2f4953a0031b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8ec9210f54c6698477d7dbbe46a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:37.446896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366239f-75ce-40eb-905e-2f4953a0031b service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:37.447204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366239f-75ce-40eb-905e-2f4953a0031b service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:37.453341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366239f-75ce-40eb-905e-2f4953a0031b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:37.457103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366239f-75ce-40eb-905e-2f4953a0031b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:37.458561 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366239f-75ce-40eb-905e-2f4953a0031b service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:37.468087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1238/2448] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:40.007812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee6bea-30a8-4e21-a5be-ebd3df9dddaf None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:40.009888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-caee6bea-30a8-4e21-a5be-ebd3df9dddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:40.093254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee6bea-30a8-4e21-a5be-ebd3df9dddaf None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:40.097937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:40.098570 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:40.098942 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:40.099229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] PATH_INFO: `/v3/users/b2ef1a82e75648afb8bd76da21158a4e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:40.100334 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ef1a82e75648afb8bd76da21158a4e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:40.102275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:40.107113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:40.165032 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ef1a82e75648afb8bd76da21158a4e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.165685 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ef1a82e75648afb8bd76da21158a4e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.172679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ef1a82e75648afb8bd76da21158a4e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.188653 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ef1a82e75648afb8bd76da21158a4e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.189423 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ef1a82e75648afb8bd76da21158a4e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.204584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1211/2449] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:40 2022] DELETE /identity/v3/users/b2ef1a82e75648afb8bd76da21158a4e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:40.209697 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c6b4b-1d34-4be9-b289-e0ac27cc0b96 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:40.210195 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c6b4b-1d34-4be9-b289-e0ac27cc0b96 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:40.210297 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c6b4b-1d34-4be9-b289-e0ac27cc0b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:40.229979 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-670c6b4b-1d34-4be9-b289-e0ac27cc0b96 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:40.231243 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-670c6b4b-1d34-4be9-b289-e0ac27cc0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:40.295782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1239/2450] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:40.308040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:40.309680 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:40.372731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53d9bc-b527-40be-83f3-6b4a70c5f666 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:40.377405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d86cd-394d-4708-bdf8-489056030b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:40.378050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d86cd-394d-4708-bdf8-489056030b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:40.378310 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d86cd-394d-4708-bdf8-489056030b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:40.379033 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d86cd-394d-4708-bdf8-489056030b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:40.390071 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d86cd-394d-4708-bdf8-489056030b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:40.391573 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d86cd-394d-4708-bdf8-489056030b8b service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:40.402069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1212/2451] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:40.683858 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c6b4b-1d34-4be9-b289-e0ac27cc0b96 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:40.685324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-670c6b4b-1d34-4be9-b289-e0ac27cc0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:40.704409 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c6b4b-1d34-4be9-b289-e0ac27cc0b96 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:40.711777 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:40.712542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:40.712868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:40.713135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] PATH_INFO: `/v3/projects/8debaf97ac8f4ef8940dfb9ba858a5b4` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:40.714599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8debaf97ac8f4ef8940dfb9ba858a5b4)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:40.716820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:40.768210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:40.779358 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8debaf97ac8f4ef8940dfb9ba858a5b4', 'request_id': 'req-9ce66d2f-688f-45ff-b778-d212ce3f3412'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.785434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8debaf97ac8f4ef8940dfb9ba858a5b4', 'request_id': 'req-9ce66d2f-688f-45ff-b778-d212ce3f3412'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.794696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8debaf97ac8f4ef8940dfb9ba858a5b4', 'request_id': 'req-9ce66d2f-688f-45ff-b778-d212ce3f3412'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.810326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] The token cache is being invalidate because project 8debaf97ac8f4ef8940dfb9ba858a5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:40.810622 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.811273 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9ce66d2f-688f-45ff-b778-d212ce3f3412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:40.815003 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1240/2452] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:40 2022] DELETE /identity/v3/projects/8debaf97ac8f4ef8940dfb9ba858a5b4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:40.818108 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774604-2352-4bbc-acb1-8c87563bb8f5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:40.818393 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774604-2352-4bbc-acb1-8c87563bb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:40.818665 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774604-2352-4bbc-acb1-8c87563bb8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:40.839186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e9774604-2352-4bbc-acb1-8c87563bb8f5 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:40.840397 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e9774604-2352-4bbc-acb1-8c87563bb8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:40.905316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1213/2453] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:40.914529 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea197-182e-431c-9dcb-03476d2f3c99 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:40.914796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea197-182e-431c-9dcb-03476d2f3c99 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:40.915091 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea197-182e-431c-9dcb-03476d2f3c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:40.935274 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f02ea197-182e-431c-9dcb-03476d2f3c99 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:40.936494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f02ea197-182e-431c-9dcb-03476d2f3c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:40.945047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1241/2454] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:40.949580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774604-2352-4bbc-acb1-8c87563bb8f5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:40.959694 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774604-2352-4bbc-acb1-8c87563bb8f5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:40.964605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91c977-e044-4e4d-b845-edd5c9a1b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:40.965194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91c977-e044-4e4d-b845-edd5c9a1b271 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:40.965503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91c977-e044-4e4d-b845-edd5c9a1b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:40.965767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91c977-e044-4e4d-b845-edd5c9a1b271 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:40.966402 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91c977-e044-4e4d-b845-edd5c9a1b271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:40.966699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91c977-e044-4e4d-b845-edd5c9a1b271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:40.968333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91c977-e044-4e4d-b845-edd5c9a1b271 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:40.980828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1214/2455] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:51:40.985576 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea197-182e-431c-9dcb-03476d2f3c99 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:40.996394 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea197-182e-431c-9dcb-03476d2f3c99 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.001516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10204a21-dc47-48cd-bcde-3b1187a9daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.002450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10204a21-dc47-48cd-bcde-3b1187a9daae admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.002721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10204a21-dc47-48cd-bcde-3b1187a9daae admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.003026 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10204a21-dc47-48cd-bcde-3b1187a9daae admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.003669 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10204a21-dc47-48cd-bcde-3b1187a9daae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.005701 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10204a21-dc47-48cd-bcde-3b1187a9daae admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.040087 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1242/2456] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:40 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:41.044336 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91c977-e044-4e4d-b845-edd5c9a1b271 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.055228 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91c977-e044-4e4d-b845-edd5c9a1b271 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.075287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:41.140127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2868c53-3dd6-4b83-965d-2c9c22e7ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.140744 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2868c53-3dd6-4b83-965d-2c9c22e7ac1c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.141162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2868c53-3dd6-4b83-965d-2c9c22e7ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.141425 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2868c53-3dd6-4b83-965d-2c9c22e7ac1c admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.142070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2868c53-3dd6-4b83-965d-2c9c22e7ac1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.144010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2868c53-3dd6-4b83-965d-2c9c22e7ac1c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.171151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1215/2457] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:41 2022] POST /identity/v3/users => generated 282 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:41.175403 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10204a21-dc47-48cd-bcde-3b1187a9daae admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.185789 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10204a21-dc47-48cd-bcde-3b1187a9daae admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.190822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746db8-3438-4fd1-86e2-d8b9d37d5700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.191520 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746db8-3438-4fd1-86e2-d8b9d37d5700 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.191797 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746db8-3438-4fd1-86e2-d8b9d37d5700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.192071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746db8-3438-4fd1-86e2-d8b9d37d5700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.192702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8746db8-3438-4fd1-86e2-d8b9d37d5700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.194450 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8746db8-3438-4fd1-86e2-d8b9d37d5700 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.204965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1243/2458] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:41.209059 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2868c53-3dd6-4b83-965d-2c9c22e7ac1c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.222070 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2868c53-3dd6-4b83-965d-2c9c22e7ac1c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.227261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b3134-0bf1-4365-bdb0-46cbe013fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.227866 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b3134-0bf1-4365-bdb0-46cbe013fba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.228138 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b3134-0bf1-4365-bdb0-46cbe013fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.228401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b3134-0bf1-4365-bdb0-46cbe013fba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.229041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b3134-0bf1-4365-bdb0-46cbe013fba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.230639 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b3134-0bf1-4365-bdb0-46cbe013fba1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.243222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1216/2459] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:41.246007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746db8-3438-4fd1-86e2-d8b9d37d5700 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.256413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746db8-3438-4fd1-86e2-d8b9d37d5700 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.261711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482caf0e-13ed-49ad-9f34-a7a5dc006b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.262389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482caf0e-13ed-49ad-9f34-a7a5dc006b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.262668 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482caf0e-13ed-49ad-9f34-a7a5dc006b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.262970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482caf0e-13ed-49ad-9f34-a7a5dc006b95 admin admin] PATH_INFO: `/v3/projects/9fb68050acb242ce929dbebdca9415de/users/ab2fc1f46f094952a41179bb13da983f/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.279299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482caf0e-13ed-49ad-9f34-a7a5dc006b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb68050acb242ce929dbebdca9415de, user_id=ab2fc1f46f094952a41179bb13da983f, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.281978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482caf0e-13ed-49ad-9f34-a7a5dc006b95 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.297581 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1244/2460] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:41 2022] PUT /identity/v3/projects/9fb68050acb242ce929dbebdca9415de/users/ab2fc1f46f094952a41179bb13da983f/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:41.308200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0bd79-4181-4dcc-82cc-0052e12983e9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.308485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0bd79-4181-4dcc-82cc-0052e12983e9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.308754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0bd79-4181-4dcc-82cc-0052e12983e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.338747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d9e0bd79-4181-4dcc-82cc-0052e12983e9 None None] MFA Rules not processed for user `ab2fc1f46f094952a41179bb13da983f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:41.340004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d9e0bd79-4181-4dcc-82cc-0052e12983e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:41.414746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1217/2461] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:41.419696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482caf0e-13ed-49ad-9f34-a7a5dc006b95 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.492112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482caf0e-13ed-49ad-9f34-a7a5dc006b95 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.496968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbb876-96a2-4dba-b689-5e870c95d51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.497607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbb876-96a2-4dba-b689-5e870c95d51e admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.497911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbb876-96a2-4dba-b689-5e870c95d51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.498112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbb876-96a2-4dba-b689-5e870c95d51e admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.505533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbb876-96a2-4dba-b689-5e870c95d51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.505533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbb876-96a2-4dba-b689-5e870c95d51e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.533372 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1245/2462] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:41 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:41.537835 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0bd79-4181-4dcc-82cc-0052e12983e9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.549516 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0bd79-4181-4dcc-82cc-0052e12983e9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.615139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3d4eb-70e0-4dad-8980-17c6efb67831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.615139 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d4eb-70e0-4dad-8980-17c6efb67831 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.615465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d4eb-70e0-4dad-8980-17c6efb67831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.615638 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d4eb-70e0-4dad-8980-17c6efb67831 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.616321 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3d4eb-70e0-4dad-8980-17c6efb67831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.618275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3d4eb-70e0-4dad-8980-17c6efb67831 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.648478 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1218/2463] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:41 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:41.650554 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbb876-96a2-4dba-b689-5e870c95d51e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.665566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbb876-96a2-4dba-b689-5e870c95d51e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.670957 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438c0aa-425d-490d-9309-0e1b47119a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.671604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438c0aa-425d-490d-9309-0e1b47119a77 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.671877 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438c0aa-425d-490d-9309-0e1b47119a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.672187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438c0aa-425d-490d-9309-0e1b47119a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.672798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438c0aa-425d-490d-9309-0e1b47119a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.674382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438c0aa-425d-490d-9309-0e1b47119a77 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.685995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1246/2464] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:41.691912 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3d4eb-70e0-4dad-8980-17c6efb67831 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.707257 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3d4eb-70e0-4dad-8980-17c6efb67831 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.713985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bcaac-1da8-4b2f-b6d5-98736d96fb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.714674 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bcaac-1da8-4b2f-b6d5-98736d96fb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.714970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bcaac-1da8-4b2f-b6d5-98736d96fb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.715241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bcaac-1da8-4b2f-b6d5-98736d96fb72 admin admin] PATH_INFO: `/v3/projects/837c2d15a9a547e5ad2d32d21a123b44/users/3ff95c1d2a614c928fd319154233e2ad/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.728371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:41.737352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bcaac-1da8-4b2f-b6d5-98736d96fb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837c2d15a9a547e5ad2d32d21a123b44, user_id=3ff95c1d2a614c928fd319154233e2ad, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.740513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bcaac-1da8-4b2f-b6d5-98736d96fb72 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.759714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1219/2465] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:41 2022] PUT /identity/v3/projects/837c2d15a9a547e5ad2d32d21a123b44/users/3ff95c1d2a614c928fd319154233e2ad/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:41.765260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438c0aa-425d-490d-9309-0e1b47119a77 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.777231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438c0aa-425d-490d-9309-0e1b47119a77 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.814972 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:41.840171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c636f6-a7f0-4f67-b831-829c10455bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.840821 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c636f6-a7f0-4f67-b831-829c10455bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.841160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c636f6-a7f0-4f67-b831-829c10455bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.841486 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c636f6-a7f0-4f67-b831-829c10455bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.842223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c636f6-a7f0-4f67-b831-829c10455bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.843862 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c636f6-a7f0-4f67-b831-829c10455bc2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.855283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1247/2466] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:41.860173 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bcaac-1da8-4b2f-b6d5-98736d96fb72 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:41.870879 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bcaac-1da8-4b2f-b6d5-98736d96fb72 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:41.875648 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c6c33-9384-4565-b4d8-6b582bb31935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:41.876301 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c6c33-9384-4565-b4d8-6b582bb31935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.876948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c6c33-9384-4565-b4d8-6b582bb31935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.877252 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c6c33-9384-4565-b4d8-6b582bb31935 admin admin] PATH_INFO: `/v3/projects/837c2d15a9a547e5ad2d32d21a123b44/users/3ff95c1d2a614c928fd319154233e2ad/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.879517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c6c33-9384-4565-b4d8-6b582bb31935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837c2d15a9a547e5ad2d32d21a123b44, user_id=3ff95c1d2a614c928fd319154233e2ad, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:41.882749 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c6c33-9384-4565-b4d8-6b582bb31935 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:41.899753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1220/2467] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:41 2022] PUT /identity/v3/projects/837c2d15a9a547e5ad2d32d21a123b44/users/3ff95c1d2a614c928fd319154233e2ad/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:41.911170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdb67b-3660-4117-93d1-7b0fe40d40ca None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:41.911455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdb67b-3660-4117-93d1-7b0fe40d40ca None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:41.911724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdb67b-3660-4117-93d1-7b0fe40d40ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:41.943930 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f3cdb67b-3660-4117-93d1-7b0fe40d40ca None None] MFA Rules not processed for user `3ff95c1d2a614c928fd319154233e2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:41.945390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f3cdb67b-3660-4117-93d1-7b0fe40d40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:42.023268 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1248/2468] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:42.036679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c6c33-9384-4565-b4d8-6b582bb31935 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:42.039389 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fa0c6c33-9384-4565-b4d8-6b582bb31935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:42.104394 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c6c33-9384-4565-b4d8-6b582bb31935 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:42.108182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a7a0-59f3-4f3a-8a95-72ac1636968f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:42.108823 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a7a0-59f3-4f3a-8a95-72ac1636968f service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:42.109097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a7a0-59f3-4f3a-8a95-72ac1636968f service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:42.109366 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a7a0-59f3-4f3a-8a95-72ac1636968f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:42.119176 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a7a0-59f3-4f3a-8a95-72ac1636968f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:42.120600 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a7a0-59f3-4f3a-8a95-72ac1636968f service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:42.131376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1221/2469] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:42.217017 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdb67b-3660-4117-93d1-7b0fe40d40ca None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:42.218660 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f3cdb67b-3660-4117-93d1-7b0fe40d40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:42.230727 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdb67b-3660-4117-93d1-7b0fe40d40ca None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:42.234467 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d8c0-b17c-491e-b539-762aa6ff7c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:42.235097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d8c0-b17c-491e-b539-762aa6ff7c3b service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:42.235366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d8c0-b17c-491e-b539-762aa6ff7c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:42.235629 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d8c0-b17c-491e-b539-762aa6ff7c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:42.297879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470d8c0-b17c-491e-b539-762aa6ff7c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:42.300080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470d8c0-b17c-491e-b539-762aa6ff7c3b service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:42.311326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1249/2470] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:47.081565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35052a-82db-4ab6-955e-769b31c24fc9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:47.082253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35052a-82db-4ab6-955e-769b31c24fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:47.082253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35052a-82db-4ab6-955e-769b31c24fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:47.105714 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5f35052a-82db-4ab6-955e-769b31c24fc9 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:47.107523 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5f35052a-82db-4ab6-955e-769b31c24fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:47.173779 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1222/2471] 10.222.0.46 () {58 vars in 1009 bytes} [Mon Oct 24 13:51:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:47.231839 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d8c0-b17c-491e-b539-762aa6ff7c3b service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:47.233536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a470d8c0-b17c-491e-b539-762aa6ff7c3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:47.311576 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:47.329152 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d8c0-b17c-491e-b539-762aa6ff7c3b service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:47.334462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ba959-af14-40b3-afab-822f44b26ad8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:47.335183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ba959-af14-40b3-afab-822f44b26ad8 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:47.335382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ba959-af14-40b3-afab-822f44b26ad8 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:47.335997 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ba959-af14-40b3-afab-822f44b26ad8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:47.346667 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ba959-af14-40b3-afab-822f44b26ad8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:47.348284 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ba959-af14-40b3-afab-822f44b26ad8 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:47.357214 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1250/2472] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:51:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:51:49.819877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35052a-82db-4ab6-955e-769b31c24fc9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:49.916231 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35052a-82db-4ab6-955e-769b31c24fc9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:49.923156 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:49.924347 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:49.924625 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:49.924892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] PATH_INFO: `/v3/users/ab2fc1f46f094952a41179bb13da983f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:49.926607 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2fc1f46f094952a41179bb13da983f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:49.930110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:49.973346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:50.036315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2fc1f46f094952a41179bb13da983f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:50.038203 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2fc1f46f094952a41179bb13da983f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:50.057761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2fc1f46f094952a41179bb13da983f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:50.073493 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2fc1f46f094952a41179bb13da983f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:50.074302 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2fc1f46f094952a41179bb13da983f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:50.092605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1223/2473] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:49 2022] DELETE /identity/v3/users/ab2fc1f46f094952a41179bb13da983f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:50.097449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32950b7-d9d9-47cd-9dc3-1e98501b2832 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:50.098006 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32950b7-d9d9-47cd-9dc3-1e98501b2832 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:50.098094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32950b7-d9d9-47cd-9dc3-1e98501b2832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:50.124461 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b32950b7-d9d9-47cd-9dc3-1e98501b2832 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:50.125863 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b32950b7-d9d9-47cd-9dc3-1e98501b2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:50.236663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1251/2474] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:50.250397 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:50.252377 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:50.357880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39c783-90bb-4185-ba62-cc7fbd51bc3d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:50.362750 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9295ed-dae5-4c34-9b28-3c1b13db0618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:50.363745 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9295ed-dae5-4c34-9b28-3c1b13db0618 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:50.363896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9295ed-dae5-4c34-9b28-3c1b13db0618 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:50.364112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9295ed-dae5-4c34-9b28-3c1b13db0618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:50.378142 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9295ed-dae5-4c34-9b28-3c1b13db0618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:50.379637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9295ed-dae5-4c34-9b28-3c1b13db0618 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:50.393558 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1224/2475] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:50.800883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32950b7-d9d9-47cd-9dc3-1e98501b2832 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:50.810366 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b32950b7-d9d9-47cd-9dc3-1e98501b2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:50.863990 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32950b7-d9d9-47cd-9dc3-1e98501b2832 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:50.886845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:50.887627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:50.887900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:50.893715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] PATH_INFO: `/v3/projects/9fb68050acb242ce929dbebdca9415de` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:50.896188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb68050acb242ce929dbebdca9415de)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:50.899066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:50.978823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb68050acb242ce929dbebdca9415de', 'request_id': 'req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:50.986229 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb68050acb242ce929dbebdca9415de', 'request_id': 'req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:50.994531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb68050acb242ce929dbebdca9415de', 'request_id': 'req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.020464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] The token cache is being invalidate because project 9fb68050acb242ce929dbebdca9415de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:51.021455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.023593 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.029286 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1252/2476] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:50 2022] DELETE /identity/v3/projects/9fb68050acb242ce929dbebdca9415de => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:51.030981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9295ed-dae5-4c34-9b28-3c1b13db0618 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:51.044539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9295ed-dae5-4c34-9b28-3c1b13db0618 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:51.136607 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:51.137279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:51.137755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:51.137937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] PATH_INFO: `/v3/users/3ff95c1d2a614c928fd319154233e2ad` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:51.139131 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff95c1d2a614c928fd319154233e2ad)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:51.141069 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:51.212141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:51.215112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff95c1d2a614c928fd319154233e2ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.215900 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff95c1d2a614c928fd319154233e2ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.227241 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff95c1d2a614c928fd319154233e2ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.244957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff95c1d2a614c928fd319154233e2ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.245837 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bdd60c20-fac8-4cad-b1e5-5872760b9b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff95c1d2a614c928fd319154233e2ad'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.264986 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1225/2477] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:51 2022] DELETE /identity/v3/users/3ff95c1d2a614c928fd319154233e2ad => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:51.662490 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:51.663965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:51.679653 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ff36f-1175-4eb3-9b6d-b324ee289d17 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:51.765836 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:51.766704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:51.767160 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:51.767747 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] PATH_INFO: `/v3/projects/837c2d15a9a547e5ad2d32d21a123b44` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:51.769910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=837c2d15a9a547e5ad2d32d21a123b44)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:51.772770 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:51.786395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:51.848927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837c2d15a9a547e5ad2d32d21a123b44', 'request_id': 'req-946e98e3-283d-40a1-a445-7ec849aa2f2e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.861534 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837c2d15a9a547e5ad2d32d21a123b44', 'request_id': 'req-946e98e3-283d-40a1-a445-7ec849aa2f2e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.883088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837c2d15a9a547e5ad2d32d21a123b44', 'request_id': 'req-946e98e3-283d-40a1-a445-7ec849aa2f2e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.902518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] The token cache is being invalidate because project 837c2d15a9a547e5ad2d32d21a123b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:51.902811 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.903536 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-946e98e3-283d-40a1-a445-7ec849aa2f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:51.905531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1253/2478] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:51 2022] DELETE /identity/v3/projects/837c2d15a9a547e5ad2d32d21a123b44 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:51.910595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018bf34-8123-4e78-9e42-f5eda59e4a26 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:51.910877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018bf34-8123-4e78-9e42-f5eda59e4a26 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:51.911167 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018bf34-8123-4e78-9e42-f5eda59e4a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:51.931751 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a018bf34-8123-4e78-9e42-f5eda59e4a26 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:51.932959 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a018bf34-8123-4e78-9e42-f5eda59e4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:52.014869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1226/2479] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:52.022977 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3038d-830c-4794-b72e-6f05cb861ce8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.023260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3038d-830c-4794-b72e-6f05cb861ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.023543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3038d-830c-4794-b72e-6f05cb861ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.045623 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0ad3038d-830c-4794-b72e-6f05cb861ce8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:52.046825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0ad3038d-830c-4794-b72e-6f05cb861ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:52.055600 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1254/2480] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:52.059778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018bf34-8123-4e78-9e42-f5eda59e4a26 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.070908 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018bf34-8123-4e78-9e42-f5eda59e4a26 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.075765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992d12-b081-4382-9fb6-b535a2b155d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.076446 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992d12-b081-4382-9fb6-b535a2b155d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.076812 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992d12-b081-4382-9fb6-b535a2b155d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.077147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992d12-b081-4382-9fb6-b535a2b155d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.077902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff992d12-b081-4382-9fb6-b535a2b155d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:52.078265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff992d12-b081-4382-9fb6-b535a2b155d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.080398 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff992d12-b081-4382-9fb6-b535a2b155d2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.093298 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1227/2481] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:51:52.097852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3038d-830c-4794-b72e-6f05cb861ce8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.107842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3038d-830c-4794-b72e-6f05cb861ce8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.114876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a07b8-8637-4b7a-bbfe-d117d32f1713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.115508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a07b8-8637-4b7a-bbfe-d117d32f1713 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.115780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a07b8-8637-4b7a-bbfe-d117d32f1713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.116040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a07b8-8637-4b7a-bbfe-d117d32f1713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.116711 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a07b8-8637-4b7a-bbfe-d117d32f1713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.119004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a07b8-8637-4b7a-bbfe-d117d32f1713 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.163716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1255/2482] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:52 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:52.164527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992d12-b081-4382-9fb6-b535a2b155d2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.180023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992d12-b081-4382-9fb6-b535a2b155d2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.252844 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e68a52-508b-4bc6-937b-902f57946c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.253590 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e68a52-508b-4bc6-937b-902f57946c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.253930 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e68a52-508b-4bc6-937b-902f57946c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.254490 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e68a52-508b-4bc6-937b-902f57946c2d admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.255265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e68a52-508b-4bc6-937b-902f57946c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.257253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e68a52-508b-4bc6-937b-902f57946c2d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.286791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1228/2483] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:52 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:52.290658 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a07b8-8637-4b7a-bbfe-d117d32f1713 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.303336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a07b8-8637-4b7a-bbfe-d117d32f1713 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.309451 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858d55-57b1-4dd3-9fd3-2e5371bef68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.310068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858d55-57b1-4dd3-9fd3-2e5371bef68b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.310632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858d55-57b1-4dd3-9fd3-2e5371bef68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.310632 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858d55-57b1-4dd3-9fd3-2e5371bef68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.311267 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a858d55-57b1-4dd3-9fd3-2e5371bef68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.312910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a858d55-57b1-4dd3-9fd3-2e5371bef68b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.337877 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1256/2484] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:51:52.342873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e68a52-508b-4bc6-937b-902f57946c2d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.351037 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e68a52-508b-4bc6-937b-902f57946c2d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.356419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e10c5-f333-4029-99c1-d0ba122eb44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.357060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e10c5-f333-4029-99c1-d0ba122eb44f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.357428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e10c5-f333-4029-99c1-d0ba122eb44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.357687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e10c5-f333-4029-99c1-d0ba122eb44f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.358484 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e10c5-f333-4029-99c1-d0ba122eb44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.360110 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e10c5-f333-4029-99c1-d0ba122eb44f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.378247 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1229/2485] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:52.384970 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858d55-57b1-4dd3-9fd3-2e5371bef68b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.399541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858d55-57b1-4dd3-9fd3-2e5371bef68b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.407222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf93963-5b5a-445a-9031-dbe5325029ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.408528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf93963-5b5a-445a-9031-dbe5325029ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.409056 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf93963-5b5a-445a-9031-dbe5325029ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.409335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf93963-5b5a-445a-9031-dbe5325029ae admin admin] PATH_INFO: `/v3/projects/92c103e7d4a2472f9972d1366cf181c5/users/aeef6313b6e842679d2a5ee4aeee3b6c/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.432563 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf93963-5b5a-445a-9031-dbe5325029ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c103e7d4a2472f9972d1366cf181c5, user_id=aeef6313b6e842679d2a5ee4aeee3b6c, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.435382 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf93963-5b5a-445a-9031-dbe5325029ae admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.458296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1257/2486] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:52 2022] PUT /identity/v3/projects/92c103e7d4a2472f9972d1366cf181c5/users/aeef6313b6e842679d2a5ee4aeee3b6c/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:52.468660 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b339f15-cd0d-4818-afb3-f192352bb29b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.468960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b339f15-cd0d-4818-afb3-f192352bb29b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.469219 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b339f15-cd0d-4818-afb3-f192352bb29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.509883 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4b339f15-cd0d-4818-afb3-f192352bb29b None None] MFA Rules not processed for user `aeef6313b6e842679d2a5ee4aeee3b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:52.511960 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4b339f15-cd0d-4818-afb3-f192352bb29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:52.535005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:52.612460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1230/2487] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:52.613596 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf93963-5b5a-445a-9031-dbe5325029ae admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.685749 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf93963-5b5a-445a-9031-dbe5325029ae admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.692221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378e2c1-5395-402f-a100-cb6a24c9e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.693130 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e2c1-5395-402f-a100-cb6a24c9e313 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.693508 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e2c1-5395-402f-a100-cb6a24c9e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.693874 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e2c1-5395-402f-a100-cb6a24c9e313 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.694618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378e2c1-5395-402f-a100-cb6a24c9e313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.697100 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378e2c1-5395-402f-a100-cb6a24c9e313 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.734626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1258/2488] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:52 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:52.735756 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b339f15-cd0d-4818-afb3-f192352bb29b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.750503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b339f15-cd0d-4818-afb3-f192352bb29b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.815463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aff4b5-1c09-44e5-a0a8-f2aba2377fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.816613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aff4b5-1c09-44e5-a0a8-f2aba2377fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.816921 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aff4b5-1c09-44e5-a0a8-f2aba2377fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.817498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aff4b5-1c09-44e5-a0a8-f2aba2377fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.818747 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aff4b5-1c09-44e5-a0a8-f2aba2377fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.820962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aff4b5-1c09-44e5-a0a8-f2aba2377fb4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.848076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1231/2489] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:52 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:52.849395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378e2c1-5395-402f-a100-cb6a24c9e313 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.860699 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378e2c1-5395-402f-a100-cb6a24c9e313 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.865406 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91395724-3f45-4d87-8a12-119023f7fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.866147 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91395724-3f45-4d87-8a12-119023f7fe5e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.866281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91395724-3f45-4d87-8a12-119023f7fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.866562 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91395724-3f45-4d87-8a12-119023f7fe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.867323 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91395724-3f45-4d87-8a12-119023f7fe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.868843 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91395724-3f45-4d87-8a12-119023f7fe5e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.889798 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1259/2490] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:52.895667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aff4b5-1c09-44e5-a0a8-f2aba2377fb4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.908118 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aff4b5-1c09-44e5-a0a8-f2aba2377fb4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.913418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed5887-5eb6-4582-8fa7-1f4cefffd24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:52.914226 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5887-5eb6-4582-8fa7-1f4cefffd24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:52.914762 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5887-5eb6-4582-8fa7-1f4cefffd24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:52.915335 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5887-5eb6-4582-8fa7-1f4cefffd24a admin admin] PATH_INFO: `/v3/projects/7260d572560b4b2aaddd4e550dba2ff8/users/2c5788258df044d19b5684a1425a70fb/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:52.934592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed5887-5eb6-4582-8fa7-1f4cefffd24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7260d572560b4b2aaddd4e550dba2ff8, user_id=2c5788258df044d19b5684a1425a70fb, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:52.937546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed5887-5eb6-4582-8fa7-1f4cefffd24a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:52.956963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1232/2491] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:52 2022] PUT /identity/v3/projects/7260d572560b4b2aaddd4e550dba2ff8/users/2c5788258df044d19b5684a1425a70fb/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:52.961164 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91395724-3f45-4d87-8a12-119023f7fe5e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:52.974652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91395724-3f45-4d87-8a12-119023f7fe5e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:52.980672 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:53.059822 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840798a-1548-41e9-98e5-e20cb2e2dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:53.060870 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840798a-1548-41e9-98e5-e20cb2e2dc97 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:53.061213 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840798a-1548-41e9-98e5-e20cb2e2dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:53.061574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840798a-1548-41e9-98e5-e20cb2e2dc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:53.062287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840798a-1548-41e9-98e5-e20cb2e2dc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:53.064096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840798a-1548-41e9-98e5-e20cb2e2dc97 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:53.075748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1260/2492] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:53.080129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed5887-5eb6-4582-8fa7-1f4cefffd24a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:53.091889 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed5887-5eb6-4582-8fa7-1f4cefffd24a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:53.098143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5db99-982d-478a-9db1-571f1d71e4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:53.099017 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5db99-982d-478a-9db1-571f1d71e4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:53.099403 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5db99-982d-478a-9db1-571f1d71e4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:53.099774 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5db99-982d-478a-9db1-571f1d71e4b2 admin admin] PATH_INFO: `/v3/projects/7260d572560b4b2aaddd4e550dba2ff8/users/2c5788258df044d19b5684a1425a70fb/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:53.101832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5db99-982d-478a-9db1-571f1d71e4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7260d572560b4b2aaddd4e550dba2ff8, user_id=2c5788258df044d19b5684a1425a70fb, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:53.107713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5db99-982d-478a-9db1-571f1d71e4b2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:53.129865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1233/2493] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:53 2022] PUT /identity/v3/projects/7260d572560b4b2aaddd4e550dba2ff8/users/2c5788258df044d19b5684a1425a70fb/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:53.143466 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4855-43da-4dd2-94de-4762a628ea79 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:53.144145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4855-43da-4dd2-94de-4762a628ea79 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:53.144419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4855-43da-4dd2-94de-4762a628ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:53.180215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bcdc4855-43da-4dd2-94de-4762a628ea79 None None] MFA Rules not processed for user `2c5788258df044d19b5684a1425a70fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:53.181453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bcdc4855-43da-4dd2-94de-4762a628ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:53.254831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1261/2494] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:53.266194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5db99-982d-478a-9db1-571f1d71e4b2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:53.267993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3bf5db99-982d-478a-9db1-571f1d71e4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:53.330740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5db99-982d-478a-9db1-571f1d71e4b2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:53.334433 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b724613-f1bf-4d4f-81ee-fb1db35386a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:53.335187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b724613-f1bf-4d4f-81ee-fb1db35386a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:53.335462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b724613-f1bf-4d4f-81ee-fb1db35386a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:53.335734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b724613-f1bf-4d4f-81ee-fb1db35386a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:53.345846 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b724613-f1bf-4d4f-81ee-fb1db35386a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:53.347333 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b724613-f1bf-4d4f-81ee-fb1db35386a4 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:53.358672 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1234/2495] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:53.486007 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4855-43da-4dd2-94de-4762a628ea79 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:53.498107 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4855-43da-4dd2-94de-4762a628ea79 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:53.503325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be71dba-483c-4700-84a2-c0a760165727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:53.504839 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be71dba-483c-4700-84a2-c0a760165727 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:53.505123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be71dba-483c-4700-84a2-c0a760165727 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:53.505396 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be71dba-483c-4700-84a2-c0a760165727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:53.592355 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be71dba-483c-4700-84a2-c0a760165727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:53.594039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be71dba-483c-4700-84a2-c0a760165727 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:53.606894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1262/2496] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:51:56.457778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b724613-f1bf-4d4f-81ee-fb1db35386a4 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:56.472989 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:56.541300 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b724613-f1bf-4d4f-81ee-fb1db35386a4 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:56.547045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:56.548283 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:56.548907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:56.549272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] PATH_INFO: `/v3/users/aeef6313b6e842679d2a5ee4aeee3b6c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:56.550719 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeef6313b6e842679d2a5ee4aeee3b6c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:56.553409 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:56.620178 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeef6313b6e842679d2a5ee4aeee3b6c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:56.620896 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeef6313b6e842679d2a5ee4aeee3b6c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:56.630376 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeef6313b6e842679d2a5ee4aeee3b6c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:56.644724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeef6313b6e842679d2a5ee4aeee3b6c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:56.645445 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeef6313b6e842679d2a5ee4aeee3b6c'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:56.663024 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1235/2497] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:56 2022] DELETE /identity/v3/users/aeef6313b6e842679d2a5ee4aeee3b6c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:56.667673 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df049-f1c9-46ab-852a-6fa37d311941 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:56.668177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df049-f1c9-46ab-852a-6fa37d311941 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:56.668291 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df049-f1c9-46ab-852a-6fa37d311941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:56.688693 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a39df049-f1c9-46ab-852a-6fa37d311941 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:56.690247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a39df049-f1c9-46ab-852a-6fa37d311941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:56.717575 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:56.768651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1263/2498] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:56.774705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:56.776309 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:56.854281 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c509c04-39de-49f8-94dd-031a7980b687 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:56.858789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecc167-7ea3-48f8-8240-75d75f3de640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:56.860272 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecc167-7ea3-48f8-8240-75d75f3de640 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:56.861360 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecc167-7ea3-48f8-8240-75d75f3de640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:56.861821 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecc167-7ea3-48f8-8240-75d75f3de640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:56.872940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecc167-7ea3-48f8-8240-75d75f3de640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:56.874397 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecc167-7ea3-48f8-8240-75d75f3de640 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:56.888111 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1236/2499] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:51:57.347793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df049-f1c9-46ab-852a-6fa37d311941 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:57.349414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a39df049-f1c9-46ab-852a-6fa37d311941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:57.364197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df049-f1c9-46ab-852a-6fa37d311941 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:57.370278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:57.371045 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:57.371326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:57.372002 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] PATH_INFO: `/v3/projects/92c103e7d4a2472f9972d1366cf181c5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:57.372722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c103e7d4a2472f9972d1366cf181c5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:57.374691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:57.431182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c103e7d4a2472f9972d1366cf181c5', 'request_id': 'req-bf8e279d-f170-472a-8073-95fa709eee18'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.437418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c103e7d4a2472f9972d1366cf181c5', 'request_id': 'req-bf8e279d-f170-472a-8073-95fa709eee18'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.444166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c103e7d4a2472f9972d1366cf181c5', 'request_id': 'req-bf8e279d-f170-472a-8073-95fa709eee18'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.459036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] The token cache is being invalidate because project 92c103e7d4a2472f9972d1366cf181c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:57.459322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.459945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.461608 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1264/2500] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:57 2022] DELETE /identity/v3/projects/92c103e7d4a2472f9972d1366cf181c5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:57.465731 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecc167-7ea3-48f8-8240-75d75f3de640 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:57.476146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecc167-7ea3-48f8-8240-75d75f3de640 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:57.508687 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:57.541004 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:57.544773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:57.545091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:57.545358 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] PATH_INFO: `/v3/users/2c5788258df044d19b5684a1425a70fb` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:57.546760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5788258df044d19b5684a1425a70fb)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:57.548869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:57.632765 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5788258df044d19b5684a1425a70fb'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.633460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5788258df044d19b5684a1425a70fb'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.644451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5788258df044d19b5684a1425a70fb'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.662035 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5788258df044d19b5684a1425a70fb'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.662875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b5ceac06-4976-4047-8781-4d6428002180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5788258df044d19b5684a1425a70fb'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:57.691000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1237/2501] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:51:57 2022] DELETE /identity/v3/users/2c5788258df044d19b5684a1425a70fb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:58.014766 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:58.016582 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:58.045991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e279d-f170-472a-8073-95fa709eee18 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:58.116875 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:58.118725 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:58.119096 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:58.119442 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] PATH_INFO: `/v3/projects/7260d572560b4b2aaddd4e550dba2ff8` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:58.120795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7260d572560b4b2aaddd4e550dba2ff8)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:58.122761 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:58.179312 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7260d572560b4b2aaddd4e550dba2ff8', 'request_id': 'req-7688d321-20bf-40d3-a1a8-a56133b1477a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:58.184114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:58.186500 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7260d572560b4b2aaddd4e550dba2ff8', 'request_id': 'req-7688d321-20bf-40d3-a1a8-a56133b1477a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:58.194772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7260d572560b4b2aaddd4e550dba2ff8', 'request_id': 'req-7688d321-20bf-40d3-a1a8-a56133b1477a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:58.218455 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] The token cache is being invalidate because project 7260d572560b4b2aaddd4e550dba2ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:51:58.219133 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:58.219824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7688d321-20bf-40d3-a1a8-a56133b1477a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:51:58.222249 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1265/2502] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:51:58 2022] DELETE /identity/v3/projects/7260d572560b4b2aaddd4e550dba2ff8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:58.228010 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f1b3e-0150-4240-97cf-bf5c46ef7c52 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:58.228526 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f1b3e-0150-4240-97cf-bf5c46ef7c52 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:58.229022 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f1b3e-0150-4240-97cf-bf5c46ef7c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:58.252943 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-666f1b3e-0150-4240-97cf-bf5c46ef7c52 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:58.254011 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-666f1b3e-0150-4240-97cf-bf5c46ef7c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:58.342970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1238/2503] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:58.357778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541a4e5-febd-4d31-bd5e-050e53567c0f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:58.358694 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541a4e5-febd-4d31-bd5e-050e53567c0f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:58.359607 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541a4e5-febd-4d31-bd5e-050e53567c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:58.396864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5541a4e5-febd-4d31-bd5e-050e53567c0f None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:58.400235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5541a4e5-febd-4d31-bd5e-050e53567c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:58.415059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1266/2504] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:58.416049 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f1b3e-0150-4240-97cf-bf5c46ef7c52 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:58.437442 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f1b3e-0150-4240-97cf-bf5c46ef7c52 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:58.446077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a949-1feb-430b-bffa-c727f812b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:58.447340 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a949-1feb-430b-bffa-c727f812b37d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:58.447704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a949-1feb-430b-bffa-c727f812b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:58.448064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a949-1feb-430b-bffa-c727f812b37d admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:58.449734 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464a949-1feb-430b-bffa-c727f812b37d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:51:58.450152 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464a949-1feb-430b-bffa-c727f812b37d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:58.452458 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464a949-1feb-430b-bffa-c727f812b37d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:58.482777 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541a4e5-febd-4d31-bd5e-050e53567c0f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:58.483044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1239/2505] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:51:58.494078 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541a4e5-febd-4d31-bd5e-050e53567c0f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:58.507259 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d82da-727c-4500-9dda-313b7d45a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:58.508400 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d82da-727c-4500-9dda-313b7d45a2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:58.508888 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d82da-727c-4500-9dda-313b7d45a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:58.509364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d82da-727c-4500-9dda-313b7d45a2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:58.511644 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d82da-727c-4500-9dda-313b7d45a2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:58.514569 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d82da-727c-4500-9dda-313b7d45a2f1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:58.557336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1267/2506] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:58 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:58.562341 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a949-1feb-430b-bffa-c727f812b37d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:58.598825 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a949-1feb-430b-bffa-c727f812b37d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:58.669234 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:58.728246 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07562091-b9c5-4cbe-9cc8-cda4cb4ebf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:58.728866 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07562091-b9c5-4cbe-9cc8-cda4cb4ebf2e admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:58.729141 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07562091-b9c5-4cbe-9cc8-cda4cb4ebf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:58.729407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07562091-b9c5-4cbe-9cc8-cda4cb4ebf2e admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:58.731043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07562091-b9c5-4cbe-9cc8-cda4cb4ebf2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:58.733049 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07562091-b9c5-4cbe-9cc8-cda4cb4ebf2e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:58.783086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1240/2507] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:58 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:58.784294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d82da-727c-4500-9dda-313b7d45a2f1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:58.797319 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d82da-727c-4500-9dda-313b7d45a2f1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:58.805992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c466e7-f908-495f-9780-82c183f9c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:58.806604 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c466e7-f908-495f-9780-82c183f9c2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:58.807551 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c466e7-f908-495f-9780-82c183f9c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:58.807839 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c466e7-f908-495f-9780-82c183f9c2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:58.808584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c466e7-f908-495f-9780-82c183f9c2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:58.811512 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c466e7-f908-495f-9780-82c183f9c2b4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:58.832942 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1268/2508] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:58.833455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07562091-b9c5-4cbe-9cc8-cda4cb4ebf2e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:58.847637 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07562091-b9c5-4cbe-9cc8-cda4cb4ebf2e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:58.858853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa47ea-b762-45be-80f4-e313a0e6cdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:58.859501 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa47ea-b762-45be-80f4-e313a0e6cdbe admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:58.859773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa47ea-b762-45be-80f4-e313a0e6cdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:58.860040 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa47ea-b762-45be-80f4-e313a0e6cdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:58.860955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa47ea-b762-45be-80f4-e313a0e6cdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:58.886157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa47ea-b762-45be-80f4-e313a0e6cdbe admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:58.899106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1241/2509] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:58.903652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c466e7-f908-495f-9780-82c183f9c2b4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:58.949965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c466e7-f908-495f-9780-82c183f9c2b4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:58.969937 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8816-a576-4d29-b314-94eb27cf2e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:58.970931 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8816-a576-4d29-b314-94eb27cf2e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:58.974454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8816-a576-4d29-b314-94eb27cf2e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:58.975083 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8816-a576-4d29-b314-94eb27cf2e24 admin admin] PATH_INFO: `/v3/projects/50d2ec8a848440e7833535fb819501df/users/a55e3fcac64a4fa3965b49d12b9d6565/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:59.043686 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c8816-a576-4d29-b314-94eb27cf2e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d2ec8a848440e7833535fb819501df, user_id=a55e3fcac64a4fa3965b49d12b9d6565, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:59.053023 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c8816-a576-4d29-b314-94eb27cf2e24 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:59.085516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1269/2510] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:58 2022] PUT /identity/v3/projects/50d2ec8a848440e7833535fb819501df/users/a55e3fcac64a4fa3965b49d12b9d6565/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:51:59.096370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d1d5-280a-4f88-a2a7-c3bce0310c61 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:59.096657 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d1d5-280a-4f88-a2a7-c3bce0310c61 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:59.096931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d1d5-280a-4f88-a2a7-c3bce0310c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:59.135230 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0c52d1d5-280a-4f88-a2a7-c3bce0310c61 None None] MFA Rules not processed for user `a55e3fcac64a4fa3965b49d12b9d6565`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:59.137073 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0c52d1d5-280a-4f88-a2a7-c3bce0310c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:59.211041 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1242/2511] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:51:59.216154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8816-a576-4d29-b314-94eb27cf2e24 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:59.297143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8816-a576-4d29-b314-94eb27cf2e24 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:59.302322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f6be-bc21-4dab-83ab-2e1a3090c492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:59.302963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f6be-bc21-4dab-83ab-2e1a3090c492 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:59.303245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f6be-bc21-4dab-83ab-2e1a3090c492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:59.303523 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f6be-bc21-4dab-83ab-2e1a3090c492 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:59.304239 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494f6be-bc21-4dab-83ab-2e1a3090c492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:59.306197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494f6be-bc21-4dab-83ab-2e1a3090c492 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:59.343075 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1270/2512] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:59 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:59.343727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52d1d5-280a-4f88-a2a7-c3bce0310c61 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:59.361894 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52d1d5-280a-4f88-a2a7-c3bce0310c61 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:59.454277 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30ec4-d240-4254-a899-7e49a061539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:59.455212 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30ec4-d240-4254-a899-7e49a061539e admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:59.455663 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30ec4-d240-4254-a899-7e49a061539e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:59.455946 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30ec4-d240-4254-a899-7e49a061539e admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:59.456755 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e30ec4-d240-4254-a899-7e49a061539e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:59.458907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e30ec4-d240-4254-a899-7e49a061539e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:59.489276 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f6be-bc21-4dab-83ab-2e1a3090c492 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:59.490345 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1243/2513] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:59 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:51:59.501171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f6be-bc21-4dab-83ab-2e1a3090c492 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:59.507135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca483b2-46dd-4801-be48-0361d344a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:59.507834 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca483b2-46dd-4801-be48-0361d344a6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:59.508111 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca483b2-46dd-4801-be48-0361d344a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:59.508538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca483b2-46dd-4801-be48-0361d344a6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:59.509192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca483b2-46dd-4801-be48-0361d344a6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:59.510812 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca483b2-46dd-4801-be48-0361d344a6b2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:59.523484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1271/2514] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:59.529834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30ec4-d240-4254-a899-7e49a061539e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:59.548760 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30ec4-d240-4254-a899-7e49a061539e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:59.554199 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffa989-450a-45cb-8d82-1e3912ba5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:59.555549 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa989-450a-45cb-8d82-1e3912ba5332 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:59.556210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa989-450a-45cb-8d82-1e3912ba5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:59.556788 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa989-450a-45cb-8d82-1e3912ba5332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:59.558316 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffa989-450a-45cb-8d82-1e3912ba5332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:59.562437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffa989-450a-45cb-8d82-1e3912ba5332 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:59.577635 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1244/2515] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:51:59.582105 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca483b2-46dd-4801-be48-0361d344a6b2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:59.592840 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca483b2-46dd-4801-be48-0361d344a6b2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:59.597868 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a16744-8696-4d54-92ab-4c7e546bd5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:59.598539 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a16744-8696-4d54-92ab-4c7e546bd5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:59.598820 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a16744-8696-4d54-92ab-4c7e546bd5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:59.599116 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a16744-8696-4d54-92ab-4c7e546bd5f7 admin admin] PATH_INFO: `/v3/projects/fd28f7da8d204dc094d8618c9eca88b8/users/a62d9f85b31f41858977f8df09f46ecb/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:59.616605 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a16744-8696-4d54-92ab-4c7e546bd5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd28f7da8d204dc094d8618c9eca88b8, user_id=a62d9f85b31f41858977f8df09f46ecb, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:59.619390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a16744-8696-4d54-92ab-4c7e546bd5f7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:59.637399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1272/2516] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:51:59 2022] PUT /identity/v3/projects/fd28f7da8d204dc094d8618c9eca88b8/users/a62d9f85b31f41858977f8df09f46ecb/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:51:59.649429 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d98ec-89f3-40a8-89d5-13aebbfbf2b5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:59.649822 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d98ec-89f3-40a8-89d5-13aebbfbf2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:59.649941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d98ec-89f3-40a8-89d5-13aebbfbf2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:59.681796 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8e7d98ec-89f3-40a8-89d5-13aebbfbf2b5 None None] MFA Rules not processed for user `a62d9f85b31f41858977f8df09f46ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:51:59.683224 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8e7d98ec-89f3-40a8-89d5-13aebbfbf2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:51:59.705583 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:59.785633 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1245/2517] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:51:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:51:59.790177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a16744-8696-4d54-92ab-4c7e546bd5f7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:59.826393 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:59.869324 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a16744-8696-4d54-92ab-4c7e546bd5f7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:51:59.874895 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa745cd-f5a1-4022-a6f9-a9ca26cc63cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:51:59.875924 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa745cd-f5a1-4022-a6f9-a9ca26cc63cc admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:51:59.876823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa745cd-f5a1-4022-a6f9-a9ca26cc63cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:51:59.877975 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa745cd-f5a1-4022-a6f9-a9ca26cc63cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:51:59.881259 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa745cd-f5a1-4022-a6f9-a9ca26cc63cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:51:59.884015 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa745cd-f5a1-4022-a6f9-a9ca26cc63cc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:51:59.938408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d98ec-89f3-40a8-89d5-13aebbfbf2b5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:51:59.941282 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1273/2518] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:51:59 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:51:59.951540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d98ec-89f3-40a8-89d5-13aebbfbf2b5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:00.037746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed8772-f0d8-4a60-9bbb-e5a8efc45c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:00.038392 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed8772-f0d8-4a60-9bbb-e5a8efc45c32 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:00.038647 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed8772-f0d8-4a60-9bbb-e5a8efc45c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:00.038917 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed8772-f0d8-4a60-9bbb-e5a8efc45c32 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:00.039598 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed8772-f0d8-4a60-9bbb-e5a8efc45c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:00.041671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed8772-f0d8-4a60-9bbb-e5a8efc45c32 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:00.075578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1246/2519] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:51:59 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:52:00.077036 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa745cd-f5a1-4022-a6f9-a9ca26cc63cc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:00.092171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa745cd-f5a1-4022-a6f9-a9ca26cc63cc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:00.106546 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eba1d-3955-45f3-976d-01115f7c79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:00.107335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eba1d-3955-45f3-976d-01115f7c79ee admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:00.108066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eba1d-3955-45f3-976d-01115f7c79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:00.108066 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eba1d-3955-45f3-976d-01115f7c79ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:00.109013 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eba1d-3955-45f3-976d-01115f7c79ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:00.110665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eba1d-3955-45f3-976d-01115f7c79ee admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:00.137788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1274/2520] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:00.142000 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed8772-f0d8-4a60-9bbb-e5a8efc45c32 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:00.152893 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed8772-f0d8-4a60-9bbb-e5a8efc45c32 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:00.157981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508d2e5-0490-4ea6-bad6-511ea5c82691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:00.158724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508d2e5-0490-4ea6-bad6-511ea5c82691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:00.159101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508d2e5-0490-4ea6-bad6-511ea5c82691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:00.159416 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508d2e5-0490-4ea6-bad6-511ea5c82691 admin admin] PATH_INFO: `/v3/projects/0b045302946b444197663262765230d8/users/378016f82b7440059bdd92018fdf0603/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:00.176221 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508d2e5-0490-4ea6-bad6-511ea5c82691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b045302946b444197663262765230d8, user_id=378016f82b7440059bdd92018fdf0603, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:00.179162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508d2e5-0490-4ea6-bad6-511ea5c82691 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:00.219913 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1247/2521] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:52:00 2022] PUT /identity/v3/projects/0b045302946b444197663262765230d8/users/378016f82b7440059bdd92018fdf0603/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:00.224415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eba1d-3955-45f3-976d-01115f7c79ee admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:00.243853 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eba1d-3955-45f3-976d-01115f7c79ee admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:00.323515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149fa18-0017-429b-93cf-02cc3e967006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:00.324779 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149fa18-0017-429b-93cf-02cc3e967006 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:00.325230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149fa18-0017-429b-93cf-02cc3e967006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:00.325963 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149fa18-0017-429b-93cf-02cc3e967006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:00.327645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149fa18-0017-429b-93cf-02cc3e967006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:00.331760 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149fa18-0017-429b-93cf-02cc3e967006 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:00.348344 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1275/2522] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:00.352880 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508d2e5-0490-4ea6-bad6-511ea5c82691 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:00.367210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508d2e5-0490-4ea6-bad6-511ea5c82691 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:00.379418 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05187a7e-c1d0-459c-bc01-0124e06b4944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:00.380325 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149fa18-0017-429b-93cf-02cc3e967006 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:00.381147 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187a7e-c1d0-459c-bc01-0124e06b4944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:00.381624 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187a7e-c1d0-459c-bc01-0124e06b4944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:00.382102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187a7e-c1d0-459c-bc01-0124e06b4944 admin admin] PATH_INFO: `/v3/projects/0b045302946b444197663262765230d8/users/378016f82b7440059bdd92018fdf0603/roles/581091dd624142d3aad6710d1eb0affa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:00.382220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a149fa18-0017-429b-93cf-02cc3e967006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:00.384769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05187a7e-c1d0-459c-bc01-0124e06b4944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b045302946b444197663262765230d8, user_id=378016f82b7440059bdd92018fdf0603, role_id=581091dd624142d3aad6710d1eb0affa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:00.388380 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05187a7e-c1d0-459c-bc01-0124e06b4944 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:00.400806 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1248/2523] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:52:00 2022] PUT /identity/v3/projects/0b045302946b444197663262765230d8/users/378016f82b7440059bdd92018fdf0603/roles/581091dd624142d3aad6710d1eb0affa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:00.411292 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b9ad6-ab78-4767-b924-a9f2a8e4628e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:00.411857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b9ad6-ab78-4767-b924-a9f2a8e4628e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:00.412362 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b9ad6-ab78-4767-b924-a9f2a8e4628e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:00.456869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ff2b9ad6-ab78-4767-b924-a9f2a8e4628e None None] MFA Rules not processed for user `378016f82b7440059bdd92018fdf0603`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:00.458287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ff2b9ad6-ab78-4767-b924-a9f2a8e4628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:00.485339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149fa18-0017-429b-93cf-02cc3e967006 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:00.565756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123b2d2-afbe-4869-af92-9fc3a2ccb5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:00.566611 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123b2d2-afbe-4869-af92-9fc3a2ccb5ae service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:00.566757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:00.567309 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123b2d2-afbe-4869-af92-9fc3a2ccb5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:00.567602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123b2d2-afbe-4869-af92-9fc3a2ccb5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:00.569572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a123b2d2-afbe-4869-af92-9fc3a2ccb5ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:00.580397 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:00.586424 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1249/2524] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:52:00.599956 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b9ad6-ab78-4767-b924-a9f2a8e4628e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:00.601611 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ff2b9ad6-ab78-4767-b924-a9f2a8e4628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:00.660692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123b2d2-afbe-4869-af92-9fc3a2ccb5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:00.662278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123b2d2-afbe-4869-af92-9fc3a2ccb5ae service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:00.682079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b9ad6-ab78-4767-b924-a9f2a8e4628e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:00.683183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1276/2525] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:00.686767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420359-1fb5-4c16-8cf9-600772a477b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:00.687428 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420359-1fb5-4c16-8cf9-600772a477b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:00.687706 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420359-1fb5-4c16-8cf9-600772a477b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:00.687977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420359-1fb5-4c16-8cf9-600772a477b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:00.761941 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da420359-1fb5-4c16-8cf9-600772a477b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:00.763938 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da420359-1fb5-4c16-8cf9-600772a477b8 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:00.775076 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1250/2526] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:52:02.535712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123b2d2-afbe-4869-af92-9fc3a2ccb5ae service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:02.548691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123b2d2-afbe-4869-af92-9fc3a2ccb5ae service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:02.555371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57046e-264a-439f-9b48-8d6c791cb299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:02.556046 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57046e-264a-439f-9b48-8d6c791cb299 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:02.556415 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57046e-264a-439f-9b48-8d6c791cb299 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:02.556795 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57046e-264a-439f-9b48-8d6c791cb299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:02.626248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57046e-264a-439f-9b48-8d6c791cb299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:02.628174 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57046e-264a-439f-9b48-8d6c791cb299 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:02.658574 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1277/2527] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:03.709331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420359-1fb5-4c16-8cf9-600772a477b8 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:03.721194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420359-1fb5-4c16-8cf9-600772a477b8 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:03.731187 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec9a42-7af7-41e9-93db-4cb3e0b71bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:03.731830 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec9a42-7af7-41e9-93db-4cb3e0b71bfc service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:03.732153 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec9a42-7af7-41e9-93db-4cb3e0b71bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:03.732603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec9a42-7af7-41e9-93db-4cb3e0b71bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:03.755902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec9a42-7af7-41e9-93db-4cb3e0b71bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:03.759832 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec9a42-7af7-41e9-93db-4cb3e0b71bfc service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:03.783581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1251/2528] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:06.730724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895bb47-05eb-44b5-adc8-d43e8116efa0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:06.731255 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895bb47-05eb-44b5-adc8-d43e8116efa0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:06.731412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895bb47-05eb-44b5-adc8-d43e8116efa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:06.752025 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5895bb47-05eb-44b5-adc8-d43e8116efa0 None None] MFA Rules not processed for user `4c7f48b7688f4bbbb318f0ea8178d5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:06.753590 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5895bb47-05eb-44b5-adc8-d43e8116efa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:06.810939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1278/2529] 10.222.0.46 () {58 vars in 967 bytes} [Mon Oct 24 13:52:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:06.826229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec9a42-7af7-41e9-93db-4cb3e0b71bfc service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:06.826229 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-68ec9a42-7af7-41e9-93db-4cb3e0b71bfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:06.901444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec9a42-7af7-41e9-93db-4cb3e0b71bfc service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:06.907083 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da80c02-c31d-4afe-9837-f06f31ef9714 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28110c7825734d229ac61878eacbe49e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:06.907578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da80c02-c31d-4afe-9837-f06f31ef9714 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:06.907838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da80c02-c31d-4afe-9837-f06f31ef9714 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:06.908184 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da80c02-c31d-4afe-9837-f06f31ef9714 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:06.917382 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da80c02-c31d-4afe-9837-f06f31ef9714 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:06.919025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da80c02-c31d-4afe-9837-f06f31ef9714 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:06.928194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1252/2530] 10.222.0.46 () {60 vars in 1384 bytes} [Mon Oct 24 13:52:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:07.811412 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895bb47-05eb-44b5-adc8-d43e8116efa0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:07.863173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:07.879980 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895bb47-05eb-44b5-adc8-d43e8116efa0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:07.886064 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:07.886696 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:07.886958 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:07.887261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] PATH_INFO: `/v3/users/a55e3fcac64a4fa3965b49d12b9d6565` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:07.888530 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55e3fcac64a4fa3965b49d12b9d6565)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:07.890477 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:07.943187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55e3fcac64a4fa3965b49d12b9d6565'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:07.944123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55e3fcac64a4fa3965b49d12b9d6565'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:07.954859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55e3fcac64a4fa3965b49d12b9d6565'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:07.969173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55e3fcac64a4fa3965b49d12b9d6565'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:07.969845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55e3fcac64a4fa3965b49d12b9d6565'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:07.985367 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1279/2531] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:07 2022] DELETE /identity/v3/users/a55e3fcac64a4fa3965b49d12b9d6565 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:07.990317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251c139-a0b4-4fe9-adb8-73983bd49e10 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:07.990770 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251c139-a0b4-4fe9-adb8-73983bd49e10 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:07.990972 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251c139-a0b4-4fe9-adb8-73983bd49e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:08.013536 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6251c139-a0b4-4fe9-adb8-73983bd49e10 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:08.014767 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6251c139-a0b4-4fe9-adb8-73983bd49e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:08.037892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:08.083444 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1253/2532] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:08.095202 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:08.099080 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:08.154371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e87f27-28a9-4b87-aa9e-f620f3c4c411 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:08.158864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417efd0-bf0f-4270-8414-55c9825a753a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:08.159502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417efd0-bf0f-4270-8414-55c9825a753a service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:08.159782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417efd0-bf0f-4270-8414-55c9825a753a service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:08.160055 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417efd0-bf0f-4270-8414-55c9825a753a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:08.169695 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417efd0-bf0f-4270-8414-55c9825a753a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:08.171176 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417efd0-bf0f-4270-8414-55c9825a753a service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:08.181238 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1280/2533] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:08.556086 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251c139-a0b4-4fe9-adb8-73983bd49e10 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:08.557929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6251c139-a0b4-4fe9-adb8-73983bd49e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:08.570515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251c139-a0b4-4fe9-adb8-73983bd49e10 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:08.575857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:08.576579 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:08.576854 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:08.577122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] PATH_INFO: `/v3/projects/50d2ec8a848440e7833535fb819501df` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:08.578350 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d2ec8a848440e7833535fb819501df)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:08.580339 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:08.637326 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d2ec8a848440e7833535fb819501df', 'request_id': 'req-91c9fe04-aa04-40a9-81f8-2d72ad09a651'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.643595 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d2ec8a848440e7833535fb819501df', 'request_id': 'req-91c9fe04-aa04-40a9-81f8-2d72ad09a651'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.649979 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d2ec8a848440e7833535fb819501df', 'request_id': 'req-91c9fe04-aa04-40a9-81f8-2d72ad09a651'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.665873 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] The token cache is being invalidate because project 50d2ec8a848440e7833535fb819501df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:08.666170 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.666892 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.671723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1254/2534] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:08 2022] DELETE /identity/v3/projects/50d2ec8a848440e7833535fb819501df => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:08.675515 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417efd0-bf0f-4270-8414-55c9825a753a service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:08.685552 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417efd0-bf0f-4270-8414-55c9825a753a service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:08.756230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:08.756889 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:08.757162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:08.757430 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] PATH_INFO: `/v3/users/a62d9f85b31f41858977f8df09f46ecb` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:08.758533 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62d9f85b31f41858977f8df09f46ecb)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:08.760482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:08.774242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:08.812370 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62d9f85b31f41858977f8df09f46ecb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.813049 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62d9f85b31f41858977f8df09f46ecb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.820966 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62d9f85b31f41858977f8df09f46ecb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.834187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62d9f85b31f41858977f8df09f46ecb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.835009 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62d9f85b31f41858977f8df09f46ecb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:08.849181 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1281/2535] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:08 2022] DELETE /identity/v3/users/a62d9f85b31f41858977f8df09f46ecb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:08.978970 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:08.980656 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:08.996769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9fe04-aa04-40a9-81f8-2d72ad09a651 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.061990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.062588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.062808 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.063112 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] PATH_INFO: `/v3/users/cbb2c47aefed45f3abfc8919693aa61b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.064249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb2c47aefed45f3abfc8919693aa61b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.066144 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.118869 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb2c47aefed45f3abfc8919693aa61b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.119874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb2c47aefed45f3abfc8919693aa61b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.126342 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:09.131217 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb2c47aefed45f3abfc8919693aa61b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.141846 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.143478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.148968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb2c47aefed45f3abfc8919693aa61b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.149853 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb2c47aefed45f3abfc8919693aa61b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.164439 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28186c23-a3ce-44d5-b83d-eab5ad2332fe admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.168584 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1255/2536] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:08 2022] DELETE /identity/v3/users/cbb2c47aefed45f3abfc8919693aa61b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:09.169447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.170814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.172155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.172969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.173337 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.173750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] PATH_INFO: `/v3/users/631587c2f37148409c63707a5f77a8d2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.175008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=631587c2f37148409c63707a5f77a8d2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.177110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.238712 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631587c2f37148409c63707a5f77a8d2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.239769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631587c2f37148409c63707a5f77a8d2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.248052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631587c2f37148409c63707a5f77a8d2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.260236 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22084-c769-491c-bccf-7fefafb6470a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.262290 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631587c2f37148409c63707a5f77a8d2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.263370 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b4f5fe4e-64f9-4484-8ce9-3a583cc0ea6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631587c2f37148409c63707a5f77a8d2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.266566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.267289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.267602 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.267831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] PATH_INFO: `/v3/projects/fd28f7da8d204dc094d8618c9eca88b8` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.268937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd28f7da8d204dc094d8618c9eca88b8)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.271209 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.282550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1282/2537] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:09 2022] DELETE /identity/v3/users/631587c2f37148409c63707a5f77a8d2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:09.287502 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31323-d607-4272-b5b5-63c52a35c3a0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.287780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31323-d607-4272-b5b5-63c52a35c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.288043 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31323-d607-4272-b5b5-63c52a35c3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.310829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-27a31323-d607-4272-b5b5-63c52a35c3a0 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:09.312106 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-27a31323-d607-4272-b5b5-63c52a35c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.328044 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd28f7da8d204dc094d8618c9eca88b8', 'request_id': 'req-66a8e14a-454c-4228-b9a8-edbc391c31a5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.335534 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd28f7da8d204dc094d8618c9eca88b8', 'request_id': 'req-66a8e14a-454c-4228-b9a8-edbc391c31a5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.343811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd28f7da8d204dc094d8618c9eca88b8', 'request_id': 'req-66a8e14a-454c-4228-b9a8-edbc391c31a5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.360962 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] The token cache is being invalidate because project fd28f7da8d204dc094d8618c9eca88b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:09.361253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.361889 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.369190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1256/2538] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:09 2022] DELETE /identity/v3/projects/fd28f7da8d204dc094d8618c9eca88b8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:09.370746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.372206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.383647 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1283/2539] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:52:09.384586 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31323-d607-4272-b5b5-63c52a35c3a0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.389726 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8e14a-454c-4228-b9a8-edbc391c31a5 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.391717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-27a31323-d607-4272-b5b5-63c52a35c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.398104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.398815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.399249 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.399521 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] PATH_INFO: `/v3/users/378016f82b7440059bdd92018fdf0603` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.400707 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=378016f82b7440059bdd92018fdf0603)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.401093 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:09.402746 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.409188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31323-d607-4272-b5b5-63c52a35c3a0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.417671 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.418332 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.419068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.419381 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] PATH_INFO: `/v3/projects/fd4e9d91abd94a919eb64c9a0d58033a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.420939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4e9d91abd94a919eb64c9a0d58033a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.423168 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.462093 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378016f82b7440059bdd92018fdf0603'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.462761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378016f82b7440059bdd92018fdf0603'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.468798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:09.471120 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378016f82b7440059bdd92018fdf0603'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.473004 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4e9d91abd94a919eb64c9a0d58033a', 'request_id': 'req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.479137 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4e9d91abd94a919eb64c9a0d58033a', 'request_id': 'req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.485190 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378016f82b7440059bdd92018fdf0603'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.485408 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4e9d91abd94a919eb64c9a0d58033a', 'request_id': 'req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.485936 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc132fc7-b8fb-4438-beb0-d918b622e11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378016f82b7440059bdd92018fdf0603'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.498742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] The token cache is being invalidate because project fd4e9d91abd94a919eb64c9a0d58033a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:09.499059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.499756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.501531 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1284/2540] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:09 2022] DELETE /identity/v3/projects/fd4e9d91abd94a919eb64c9a0d58033a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:09.502051 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.503754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1257/2541] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:09 2022] DELETE /identity/v3/users/378016f82b7440059bdd92018fdf0603 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:52:09.503883 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.508104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1962880-d67b-4b87-8e99-ee5d3d7ab215 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.508396 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1962880-d67b-4b87-8e99-ee5d3d7ab215 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.508658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1962880-d67b-4b87-8e99-ee5d3d7ab215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.531401 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e1962880-d67b-4b87-8e99-ee5d3d7ab215 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:09.532621 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e1962880-d67b-4b87-8e99-ee5d3d7ab215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.565543 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bba74c-e8b1-43cc-88ec-f5fb7111a41d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.613130 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1258/2542] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:09.615007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa53d1-1267-4bb4-82f5-11154eec6cf4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.615331 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa53d1-1267-4bb4-82f5-11154eec6cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.615622 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa53d1-1267-4bb4-82f5-11154eec6cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.623567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed77d80-e3d2-46d1-a51a-11b40a4131c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.624452 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed77d80-e3d2-46d1-a51a-11b40a4131c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.624825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed77d80-e3d2-46d1-a51a-11b40a4131c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.625189 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed77d80-e3d2-46d1-a51a-11b40a4131c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.628200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7ed77d80-e3d2-46d1-a51a-11b40a4131c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.642036 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-cafa53d1-1267-4bb4-82f5-11154eec6cf4 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:09.643415 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cafa53d1-1267-4bb4-82f5-11154eec6cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.644559 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed77d80-e3d2-46d1-a51a-11b40a4131c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.646162 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed77d80-e3d2-46d1-a51a-11b40a4131c8 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.653419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1259/2543] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:52:09.657473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa53d1-1267-4bb4-82f5-11154eec6cf4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.660235 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1285/2544] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:09.667286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa53d1-1267-4bb4-82f5-11154eec6cf4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.673146 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e86ce2-6249-470d-99b7-415b0adf653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.685543 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e86ce2-6249-470d-99b7-415b0adf653b admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.685826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e86ce2-6249-470d-99b7-415b0adf653b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.686096 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e86ce2-6249-470d-99b7-415b0adf653b admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.686781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e86ce2-6249-470d-99b7-415b0adf653b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:52:09.687109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e86ce2-6249-470d-99b7-415b0adf653b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.690527 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e86ce2-6249-470d-99b7-415b0adf653b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.712781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1260/2545] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:52:09.714377 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed77d80-e3d2-46d1-a51a-11b40a4131c8 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.725828 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed77d80-e3d2-46d1-a51a-11b40a4131c8 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.731510 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43429d-20e0-4cb0-9bf7-ce66309534a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.732295 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43429d-20e0-4cb0-9bf7-ce66309534a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.732578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43429d-20e0-4cb0-9bf7-ce66309534a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.732927 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43429d-20e0-4cb0-9bf7-ce66309534a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.733719 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43429d-20e0-4cb0-9bf7-ce66309534a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.735799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43429d-20e0-4cb0-9bf7-ce66309534a6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.771414 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1286/2546] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:52:09 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:52:09.773511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e86ce2-6249-470d-99b7-415b0adf653b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.789085 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e86ce2-6249-470d-99b7-415b0adf653b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.815177 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43429d-20e0-4cb0-9bf7-ce66309534a6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.819778 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7a43429d-20e0-4cb0-9bf7-ce66309534a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.859449 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:09.867645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1def9a-5755-40dc-b721-1ee403d470c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.868263 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1def9a-5755-40dc-b721-1ee403d470c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.868546 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1def9a-5755-40dc-b721-1ee403d470c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.868849 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1def9a-5755-40dc-b721-1ee403d470c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.869485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1def9a-5755-40dc-b721-1ee403d470c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.871494 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1def9a-5755-40dc-b721-1ee403d470c6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.898982 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1261/2547] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:52:09 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:52:09.901408 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1def9a-5755-40dc-b721-1ee403d470c6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.912246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43429d-20e0-4cb0-9bf7-ce66309534a6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.912413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1def9a-5755-40dc-b721-1ee403d470c6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.916804 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.917443 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.917673 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c8c38-8feb-4901-a743-34defe83f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.917800 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.917995 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] PATH_INFO: `/v3/projects/0b045302946b444197663262765230d8` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.918265 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c8c38-8feb-4901-a743-34defe83f5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.918537 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c8c38-8feb-4901-a743-34defe83f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.918802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c8c38-8feb-4901-a743-34defe83f5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.919129 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b045302946b444197663262765230d8)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.919469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c8c38-8feb-4901-a743-34defe83f5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.921038 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c8c38-8feb-4901-a743-34defe83f5bd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.921158 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.935511 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1262/2548] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:52:09.937061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c8c38-8feb-4901-a743-34defe83f5bd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.950116 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c8c38-8feb-4901-a743-34defe83f5bd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:09.956060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4cadd-80e6-4906-a85b-f8530176d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:09.956723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4cadd-80e6-4906-a85b-f8530176d53e admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:09.957094 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4cadd-80e6-4906-a85b-f8530176d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:09.957588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4cadd-80e6-4906-a85b-f8530176d53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:09.958372 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4cadd-80e6-4906-a85b-f8530176d53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:09.960105 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4cadd-80e6-4906-a85b-f8530176d53e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:09.974829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1263/2549] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:52:09.974829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4cadd-80e6-4906-a85b-f8530176d53e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:09.977031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f2c4cadd-80e6-4906-a85b-f8530176d53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:09.992226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b045302946b444197663262765230d8', 'request_id': 'req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:09.992473 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4cadd-80e6-4906-a85b-f8530176d53e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.000399 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b045302946b444197663262765230d8', 'request_id': 'req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:10.009032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b045302946b444197663262765230d8', 'request_id': 'req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:10.014320 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:10.024368 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] The token cache is being invalidate because project 0b045302946b444197663262765230d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:10.024655 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:10.025322 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:10.026913 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1287/2550] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:09 2022] DELETE /identity/v3/projects/0b045302946b444197663262765230d8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:52:10.031555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:10.031555 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:10.065829 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.066466 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.066743 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.067047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] PATH_INFO: `/v3/projects/99d85806fe4c4c64a6933afb3d3eeb70` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.068447 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d85806fe4c4c64a6933afb3d3eeb70)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.070367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.094194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8e192-f1e2-4957-ae6f-7c6522bc8ccf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.100008 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33bfa3-4a3d-4880-98de-34ab991e8d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.100670 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33bfa3-4a3d-4880-98de-34ab991e8d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.100948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33bfa3-4a3d-4880-98de-34ab991e8d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.101217 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33bfa3-4a3d-4880-98de-34ab991e8d5d admin admin] PATH_INFO: `/v3/projects/46a1648c87f6436db0ce7cd95ea4cce5/users/c91b3f0b870c4864939b645e6e8d1992/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.116786 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33bfa3-4a3d-4880-98de-34ab991e8d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a1648c87f6436db0ce7cd95ea4cce5, user_id=c91b3f0b870c4864939b645e6e8d1992, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.119261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d85806fe4c4c64a6933afb3d3eeb70', 'request_id': 'req-41cf8553-e2fd-4e55-b23e-719e5b29ceae'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:10.120769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33bfa3-4a3d-4880-98de-34ab991e8d5d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.125891 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d85806fe4c4c64a6933afb3d3eeb70', 'request_id': 'req-41cf8553-e2fd-4e55-b23e-719e5b29ceae'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:10.132729 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d85806fe4c4c64a6933afb3d3eeb70', 'request_id': 'req-41cf8553-e2fd-4e55-b23e-719e5b29ceae'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:10.136045 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1288/2551] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:52:10 2022] PUT /identity/v3/projects/46a1648c87f6436db0ce7cd95ea4cce5/users/c91b3f0b870c4864939b645e6e8d1992/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:10.137388 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95a10c-f30a-482a-9c91-4a5c787e3c99 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.137675 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95a10c-f30a-482a-9c91-4a5c787e3c99 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.138150 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95a10c-f30a-482a-9c91-4a5c787e3c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.156581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] The token cache is being invalidate because project 99d85806fe4c4c64a6933afb3d3eeb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:10.156865 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:10.157498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-41cf8553-e2fd-4e55-b23e-719e5b29ceae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:10.159080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1264/2552] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:09 2022] DELETE /identity/v3/projects/99d85806fe4c4c64a6933afb3d3eeb70 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:10.159703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ad95a10c-f30a-482a-9c91-4a5c787e3c99 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:10.160419 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be5bf-e459-47f9-b44e-6649d18b4241 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.160695 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be5bf-e459-47f9-b44e-6649d18b4241 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.161050 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be5bf-e459-47f9-b44e-6649d18b4241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.161188 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ad95a10c-f30a-482a-9c91-4a5c787e3c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:10.194102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c94be5bf-e459-47f9-b44e-6649d18b4241 None None] MFA Rules not processed for user `c91b3f0b870c4864939b645e6e8d1992`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:10.195948 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c94be5bf-e459-47f9-b44e-6649d18b4241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:10.198357 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:10.231857 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1289/2553] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:10.242000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34b36-3f77-4074-8f46-b617940ac2ec None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.242583 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34b36-3f77-4074-8f46-b617940ac2ec None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.242869 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34b36-3f77-4074-8f46-b617940ac2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.264992 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-39f34b36-3f77-4074-8f46-b617940ac2ec None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:10.266228 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-39f34b36-3f77-4074-8f46-b617940ac2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:10.274550 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1290/2554] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:52:10.279200 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f34b36-3f77-4074-8f46-b617940ac2ec None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:10.283289 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1265/2555] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:10.289379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f34b36-3f77-4074-8f46-b617940ac2ec None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.295068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04cfde-9bc5-45a8-a562-07d27fd3bda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.295692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04cfde-9bc5-45a8-a562-07d27fd3bda8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.295964 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04cfde-9bc5-45a8-a562-07d27fd3bda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.296230 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04cfde-9bc5-45a8-a562-07d27fd3bda8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.297270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04cfde-9bc5-45a8-a562-07d27fd3bda8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:52:10.297270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04cfde-9bc5-45a8-a562-07d27fd3bda8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.298885 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04cfde-9bc5-45a8-a562-07d27fd3bda8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.299159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be5bf-e459-47f9-b44e-6649d18b4241 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:10.300834 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c94be5bf-e459-47f9-b44e-6649d18b4241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:10.312334 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1291/2556] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:52:10.316635 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04cfde-9bc5-45a8-a562-07d27fd3bda8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:10.327112 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04cfde-9bc5-45a8-a562-07d27fd3bda8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.332252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93af5-6a05-47a4-b039-e8a4622e39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.332969 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93af5-6a05-47a4-b039-e8a4622e39ea admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.333247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93af5-6a05-47a4-b039-e8a4622e39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.333698 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93af5-6a05-47a4-b039-e8a4622e39ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.334360 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93af5-6a05-47a4-b039-e8a4622e39ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.336379 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93af5-6a05-47a4-b039-e8a4622e39ea admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.360097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:10.380976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be5bf-e459-47f9-b44e-6649d18b4241 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.384810 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204f24-1d6c-4067-996b-72b21e88d266 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8ec9210f54c6698477d7dbbe46a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.385534 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204f24-1d6c-4067-996b-72b21e88d266 service glance] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.385902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204f24-1d6c-4067-996b-72b21e88d266 service glance] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.386237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204f24-1d6c-4067-996b-72b21e88d266 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.394960 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1292/2557] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:52:10 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:52:10.397535 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93af5-6a05-47a4-b039-e8a4622e39ea admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:10.400023 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36204f24-1d6c-4067-996b-72b21e88d266 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.401483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36204f24-1d6c-4067-996b-72b21e88d266 service glance] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.411725 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1266/2558] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:10.482896 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93af5-6a05-47a4-b039-e8a4622e39ea admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.487887 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df4db-bbb6-426e-9dff-8feac612a10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.488495 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df4db-bbb6-426e-9dff-8feac612a10a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.488772 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df4db-bbb6-426e-9dff-8feac612a10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.489077 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df4db-bbb6-426e-9dff-8feac612a10a admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.489808 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03df4db-bbb6-426e-9dff-8feac612a10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.491785 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03df4db-bbb6-426e-9dff-8feac612a10a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.520155 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1293/2559] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:52:10 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:52:10.522206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204f24-1d6c-4067-996b-72b21e88d266 service glance] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:10.533349 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204f24-1d6c-4067-996b-72b21e88d266 service glance] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.538465 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f357a4-ef1a-487d-b22c-70e520363d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.539182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f357a4-ef1a-487d-b22c-70e520363d1c admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.539458 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f357a4-ef1a-487d-b22c-70e520363d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.539724 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f357a4-ef1a-487d-b22c-70e520363d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.540355 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f357a4-ef1a-487d-b22c-70e520363d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.541922 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f357a4-ef1a-487d-b22c-70e520363d1c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.552451 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1267/2560] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:10.556703 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df4db-bbb6-426e-9dff-8feac612a10a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:10.567298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df4db-bbb6-426e-9dff-8feac612a10a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.572390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f6605-4902-4db4-a476-7dd8174120a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.572989 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f6605-4902-4db4-a476-7dd8174120a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.573263 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f6605-4902-4db4-a476-7dd8174120a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.573532 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f6605-4902-4db4-a476-7dd8174120a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.574222 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f6605-4902-4db4-a476-7dd8174120a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.575891 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f6605-4902-4db4-a476-7dd8174120a7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.586287 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1294/2561] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:10.590754 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f357a4-ef1a-487d-b22c-70e520363d1c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:10.601641 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f357a4-ef1a-487d-b22c-70e520363d1c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.609567 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb8661-d06a-4842-a1b8-4f4a883706ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.610223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8661-d06a-4842-a1b8-4f4a883706ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.610498 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8661-d06a-4842-a1b8-4f4a883706ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.610789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8661-d06a-4842-a1b8-4f4a883706ab admin admin] PATH_INFO: `/v3/projects/665076ecaa764e6a8b89edee03c4caf2/users/a59402f9da87479399dad6c091c5b451/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.625886 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb8661-d06a-4842-a1b8-4f4a883706ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=665076ecaa764e6a8b89edee03c4caf2, user_id=a59402f9da87479399dad6c091c5b451, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.628977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb8661-d06a-4842-a1b8-4f4a883706ab admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.643961 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1268/2562] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:52:10 2022] PUT /identity/v3/projects/665076ecaa764e6a8b89edee03c4caf2/users/a59402f9da87479399dad6c091c5b451/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:10.654860 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4252f20-16d7-47fb-8069-e3e0badfe32a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.655224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4252f20-16d7-47fb-8069-e3e0badfe32a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.655540 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4252f20-16d7-47fb-8069-e3e0badfe32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.683503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a4252f20-16d7-47fb-8069-e3e0badfe32a None None] MFA Rules not processed for user `a59402f9da87479399dad6c091c5b451`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:10.684706 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a4252f20-16d7-47fb-8069-e3e0badfe32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:10.744756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:10.759223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1295/2563] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:52:10.769286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb8661-d06a-4842-a1b8-4f4a883706ab admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:10.771061 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dadb8661-d06a-4842-a1b8-4f4a883706ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:10.843253 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb8661-d06a-4842-a1b8-4f4a883706ab admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:10.847670 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be2088-f064-4eae-81cd-817ff62ad31e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:10.848802 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be2088-f064-4eae-81cd-817ff62ad31e service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:10.849303 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be2088-f064-4eae-81cd-817ff62ad31e service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:10.849661 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be2088-f064-4eae-81cd-817ff62ad31e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:10.859588 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be2088-f064-4eae-81cd-817ff62ad31e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:10.861028 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be2088-f064-4eae-81cd-817ff62ad31e service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:10.871051 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1269/2564] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:13.489065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4252f20-16d7-47fb-8069-e3e0badfe32a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:13.557509 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4252f20-16d7-47fb-8069-e3e0badfe32a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:13.563145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:13.563769 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:13.564038 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:13.564298 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] PATH_INFO: `/v3/users/a59402f9da87479399dad6c091c5b451` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:13.565413 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59402f9da87479399dad6c091c5b451)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:13.567440 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:13.619946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59402f9da87479399dad6c091c5b451'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:13.620609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59402f9da87479399dad6c091c5b451'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:13.627973 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59402f9da87479399dad6c091c5b451'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:13.643524 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59402f9da87479399dad6c091c5b451'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:13.644207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59402f9da87479399dad6c091c5b451'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:13.660392 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1296/2565] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:13 2022] DELETE /identity/v3/users/a59402f9da87479399dad6c091c5b451 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:13.665276 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867498-8a66-49bd-8bab-5bd89e4961ac None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:13.666035 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867498-8a66-49bd-8bab-5bd89e4961ac None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:13.666035 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867498-8a66-49bd-8bab-5bd89e4961ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:13.685949 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-28867498-8a66-49bd-8bab-5bd89e4961ac None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:13.687354 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-28867498-8a66-49bd-8bab-5bd89e4961ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:13.751950 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1270/2566] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:13.762437 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:13.764079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:13.824578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f854019-927f-4185-92b8-24e021cef369 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:13.829320 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc04c67-b798-4822-adff-2bf02de5c18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:13.829946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04c67-b798-4822-adff-2bf02de5c18a service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:13.830244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04c67-b798-4822-adff-2bf02de5c18a service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:13.830518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04c67-b798-4822-adff-2bf02de5c18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:13.841115 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc04c67-b798-4822-adff-2bf02de5c18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:13.842578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc04c67-b798-4822-adff-2bf02de5c18a service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:13.852691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1297/2567] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:14.142242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867498-8a66-49bd-8bab-5bd89e4961ac None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:14.143929 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-28867498-8a66-49bd-8bab-5bd89e4961ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:14.160322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867498-8a66-49bd-8bab-5bd89e4961ac None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:14.167117 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:14.167902 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.168072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.168343 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] PATH_INFO: `/v3/projects/665076ecaa764e6a8b89edee03c4caf2` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.169610 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665076ecaa764e6a8b89edee03c4caf2)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:14.171450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:14.221655 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:14.225047 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665076ecaa764e6a8b89edee03c4caf2', 'request_id': 'req-bb090780-6fa6-4a26-b2eb-4003975ae5d0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:14.232370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665076ecaa764e6a8b89edee03c4caf2', 'request_id': 'req-bb090780-6fa6-4a26-b2eb-4003975ae5d0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:14.238113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665076ecaa764e6a8b89edee03c4caf2', 'request_id': 'req-bb090780-6fa6-4a26-b2eb-4003975ae5d0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:14.252798 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] The token cache is being invalidate because project 665076ecaa764e6a8b89edee03c4caf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:14.253074 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:14.253696 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bb090780-6fa6-4a26-b2eb-4003975ae5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:14.255242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1271/2568] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:14 2022] DELETE /identity/v3/projects/665076ecaa764e6a8b89edee03c4caf2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:14.260674 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371c3a2-d726-442f-a141-e3c85f5e13d8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.260934 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371c3a2-d726-442f-a141-e3c85f5e13d8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.261210 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371c3a2-d726-442f-a141-e3c85f5e13d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.281948 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d371c3a2-d726-442f-a141-e3c85f5e13d8 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:14.283197 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d371c3a2-d726-442f-a141-e3c85f5e13d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:14.293244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:14.348237 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1298/2569] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:14.356563 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc52ea4-f20d-4536-951b-74dd24488f96 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.356799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc52ea4-f20d-4536-951b-74dd24488f96 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.357097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc52ea4-f20d-4536-951b-74dd24488f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.379091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bbc52ea4-f20d-4536-951b-74dd24488f96 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:14.380315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bbc52ea4-f20d-4536-951b-74dd24488f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:14.389868 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1272/2570] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:14.394528 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371c3a2-d726-442f-a141-e3c85f5e13d8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:14.405501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371c3a2-d726-442f-a141-e3c85f5e13d8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:14.411094 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ed7e2-0b61-4429-aaee-627a43062afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:14.411739 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed7e2-0b61-4429-aaee-627a43062afb admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.412014 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed7e2-0b61-4429-aaee-627a43062afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.412285 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed7e2-0b61-4429-aaee-627a43062afb admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.412939 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ed7e2-0b61-4429-aaee-627a43062afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:52:14.413240 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ed7e2-0b61-4429-aaee-627a43062afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:14.414910 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ed7e2-0b61-4429-aaee-627a43062afb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:14.427633 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1299/2571] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:52:14.432438 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc52ea4-f20d-4536-951b-74dd24488f96 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:14.441987 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc52ea4-f20d-4536-951b-74dd24488f96 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:14.447981 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0c8c1-a68e-4573-b326-51d39ef2e5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:14.448671 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c8c1-a68e-4573-b326-51d39ef2e5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.449055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c8c1-a68e-4573-b326-51d39ef2e5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.449374 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c8c1-a68e-4573-b326-51d39ef2e5c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.450079 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0c8c1-a68e-4573-b326-51d39ef2e5c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:14.452472 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0c8c1-a68e-4573-b326-51d39ef2e5c8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:14.484469 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1273/2572] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:52:14 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:52:14.488734 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ed7e2-0b61-4429-aaee-627a43062afb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:14.499651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ed7e2-0b61-4429-aaee-627a43062afb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:14.568967 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92557f1-4a2e-478f-893d-6f1862d9adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:14.569578 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92557f1-4a2e-478f-893d-6f1862d9adf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.569852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92557f1-4a2e-478f-893d-6f1862d9adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.570114 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92557f1-4a2e-478f-893d-6f1862d9adf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.570756 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92557f1-4a2e-478f-893d-6f1862d9adf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:14.573124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92557f1-4a2e-478f-893d-6f1862d9adf3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:14.596221 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1300/2573] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:52:14 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:52:14.600460 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0c8c1-a68e-4573-b326-51d39ef2e5c8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:14.611018 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0c8c1-a68e-4573-b326-51d39ef2e5c8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:14.616281 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd9483-d9dc-43f2-970e-c32ca7cb2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:14.616856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd9483-d9dc-43f2-970e-c32ca7cb2fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.617162 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd9483-d9dc-43f2-970e-c32ca7cb2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.617450 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd9483-d9dc-43f2-970e-c32ca7cb2fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.618133 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd9483-d9dc-43f2-970e-c32ca7cb2fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:14.619772 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd9483-d9dc-43f2-970e-c32ca7cb2fd7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:14.632499 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1274/2574] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:14.636751 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92557f1-4a2e-478f-893d-6f1862d9adf3 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:14.647350 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92557f1-4a2e-478f-893d-6f1862d9adf3 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:14.654039 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9b14-36bc-4d51-9168-fab4bc6929b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:14.654823 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9b14-36bc-4d51-9168-fab4bc6929b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.655139 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9b14-36bc-4d51-9168-fab4bc6929b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.655501 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9b14-36bc-4d51-9168-fab4bc6929b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.656434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9b14-36bc-4d51-9168-fab4bc6929b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:14.658864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9b14-36bc-4d51-9168-fab4bc6929b4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:14.675135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1301/2575] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:14.679025 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd9483-d9dc-43f2-970e-c32ca7cb2fd7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:14.689619 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd9483-d9dc-43f2-970e-c32ca7cb2fd7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:14.694626 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bdf08-ace8-4781-a028-7a003c08cb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:14.695332 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bdf08-ace8-4781-a028-7a003c08cb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.695576 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bdf08-ace8-4781-a028-7a003c08cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.695843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bdf08-ace8-4781-a028-7a003c08cb12 admin admin] PATH_INFO: `/v3/projects/f931c16c358b4f6db4383b8fbd67fb7a/users/5d2746d98a1a47fab7a03ffe3396231f/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.711106 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bdf08-ace8-4781-a028-7a003c08cb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f931c16c358b4f6db4383b8fbd67fb7a, user_id=5d2746d98a1a47fab7a03ffe3396231f, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:14.713785 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bdf08-ace8-4781-a028-7a003c08cb12 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:14.730134 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1275/2576] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:52:14 2022] PUT /identity/v3/projects/f931c16c358b4f6db4383b8fbd67fb7a/users/5d2746d98a1a47fab7a03ffe3396231f/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:14.798454 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e283-756b-4333-af73-564604d06958 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.798728 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e283-756b-4333-af73-564604d06958 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.799052 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e283-756b-4333-af73-564604d06958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:14.837845 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b8b6e283-756b-4333-af73-564604d06958 None None] MFA Rules not processed for user `5d2746d98a1a47fab7a03ffe3396231f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:14.839119 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b8b6e283-756b-4333-af73-564604d06958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:14.908894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1302/2577] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:14.923708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bdf08-ace8-4781-a028-7a003c08cb12 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:14.925773 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-778bdf08-ace8-4781-a028-7a003c08cb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:14.987463 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bdf08-ace8-4781-a028-7a003c08cb12 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:14.991312 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300a0b9-cfb6-4b7d-b729-7b211c150c6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:14.991914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300a0b9-cfb6-4b7d-b729-7b211c150c6a service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:14.992158 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300a0b9-cfb6-4b7d-b729-7b211c150c6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:14.992432 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300a0b9-cfb6-4b7d-b729-7b211c150c6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:15.003015 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300a0b9-cfb6-4b7d-b729-7b211c150c6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:15.004479 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300a0b9-cfb6-4b7d-b729-7b211c150c6a service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:15.014319 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1276/2578] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:24.904059 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:25.011185 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:39.669339 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6e283-756b-4333-af73-564604d06958 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:39.670954 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b8b6e283-756b-4333-af73-564604d06958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:39.740645 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6e283-756b-4333-af73-564604d06958 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:39.745627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:39.746253 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:39.746526 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:39.746801 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] PATH_INFO: `/v3/users/c91b3f0b870c4864939b645e6e8d1992` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:39.747988 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91b3f0b870c4864939b645e6e8d1992)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:39.749915 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:39.799724 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91b3f0b870c4864939b645e6e8d1992'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:39.800468 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91b3f0b870c4864939b645e6e8d1992'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:39.807211 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91b3f0b870c4864939b645e6e8d1992'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:39.819856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91b3f0b870c4864939b645e6e8d1992'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:39.820683 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91b3f0b870c4864939b645e6e8d1992'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:39.836053 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1303/2579] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:39 2022] DELETE /identity/v3/users/c91b3f0b870c4864939b645e6e8d1992 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:39.840803 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44190d-5530-4192-8e8d-50be0a94a093 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:39.841269 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44190d-5530-4192-8e8d-50be0a94a093 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:39.841367 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44190d-5530-4192-8e8d-50be0a94a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:39.859952 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fe44190d-5530-4192-8e8d-50be0a94a093 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:39.861206 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fe44190d-5530-4192-8e8d-50be0a94a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:39.922601 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1277/2580] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:39.932464 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:39.933946 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:39.992824 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb56ec-3f99-4d3c-930b-a21ad48ee26c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:39.997336 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb1987-4cf4-4346-a904-bd48f917ca9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:39.998156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1987-4cf4-4346-a904-bd48f917ca9e service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:39.998407 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1987-4cf4-4346-a904-bd48f917ca9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:39.998702 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1987-4cf4-4346-a904-bd48f917ca9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.009187 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1987-4cf4-4346-a904-bd48f917ca9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:40.010612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1987-4cf4-4346-a904-bd48f917ca9e service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:40.020303 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1304/2581] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:40.298322 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44190d-5530-4192-8e8d-50be0a94a093 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:40.300128 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fe44190d-5530-4192-8e8d-50be0a94a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:40.313102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44190d-5530-4192-8e8d-50be0a94a093 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:40.319115 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:40.319758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.320031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.320325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] PATH_INFO: `/v3/projects/46a1648c87f6436db0ce7cd95ea4cce5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.321550 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a1648c87f6436db0ce7cd95ea4cce5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:40.323662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:40.373613 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a1648c87f6436db0ce7cd95ea4cce5', 'request_id': 'req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:40.380877 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a1648c87f6436db0ce7cd95ea4cce5', 'request_id': 'req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:40.387969 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a1648c87f6436db0ce7cd95ea4cce5', 'request_id': 'req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:40.404709 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] The token cache is being invalidate because project 46a1648c87f6436db0ce7cd95ea4cce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:40.404991 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:40.405605 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a5daea8-4ea7-4303-bbeb-c128cbd93e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:40.407151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1278/2582] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:40 2022] DELETE /identity/v3/projects/46a1648c87f6436db0ce7cd95ea4cce5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:40.412386 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0333ca-39e4-4b2a-9420-d9df4e1c6071 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.412682 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0333ca-39e4-4b2a-9420-d9df4e1c6071 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.412956 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0333ca-39e4-4b2a-9420-d9df4e1c6071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.432720 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-dc0333ca-39e4-4b2a-9420-d9df4e1c6071 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:40.433898 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-dc0333ca-39e4-4b2a-9420-d9df4e1c6071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:40.453662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:40.501170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1305/2583] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:52:40.509616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc6ae-b245-44d9-82bc-bf9f865564e9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.509915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc6ae-b245-44d9-82bc-bf9f865564e9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.510186 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc6ae-b245-44d9-82bc-bf9f865564e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.536414 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-707bc6ae-b245-44d9-82bc-bf9f865564e9 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:40.537640 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-707bc6ae-b245-44d9-82bc-bf9f865564e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:40.547043 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1279/2584] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:40.551616 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0333ca-39e4-4b2a-9420-d9df4e1c6071 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:40.561894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0333ca-39e4-4b2a-9420-d9df4e1c6071 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:40.567496 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897875d9-5f07-41d8-9aa8-f073d6e9d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:40.568097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897875d9-5f07-41d8-9aa8-f073d6e9d7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.568371 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897875d9-5f07-41d8-9aa8-f073d6e9d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.568639 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897875d9-5f07-41d8-9aa8-f073d6e9d7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.569280 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897875d9-5f07-41d8-9aa8-f073d6e9d7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:52:40.569577 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897875d9-5f07-41d8-9aa8-f073d6e9d7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:40.571203 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897875d9-5f07-41d8-9aa8-f073d6e9d7ac admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:40.584302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1306/2585] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:52:40.588777 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc6ae-b245-44d9-82bc-bf9f865564e9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:40.598273 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc6ae-b245-44d9-82bc-bf9f865564e9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:40.603200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9e440-24fd-43b2-9f0c-821cb961f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:40.603794 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9e440-24fd-43b2-9f0c-821cb961f734 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.604072 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9e440-24fd-43b2-9f0c-821cb961f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.604346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9e440-24fd-43b2-9f0c-821cb961f734 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.604985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9e440-24fd-43b2-9f0c-821cb961f734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:40.606863 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9e440-24fd-43b2-9f0c-821cb961f734 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:40.638091 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1280/2586] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:52:40 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:52:40.644224 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897875d9-5f07-41d8-9aa8-f073d6e9d7ac admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:40.654369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897875d9-5f07-41d8-9aa8-f073d6e9d7ac admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:40.712117 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83897f1d-587e-49a7-b889-fffff86bd309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:40.712788 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83897f1d-587e-49a7-b889-fffff86bd309 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.712923 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83897f1d-587e-49a7-b889-fffff86bd309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.713193 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83897f1d-587e-49a7-b889-fffff86bd309 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.713816 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83897f1d-587e-49a7-b889-fffff86bd309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:40.715793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83897f1d-587e-49a7-b889-fffff86bd309 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:40.739721 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1307/2587] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:52:40 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:52:40.744172 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9e440-24fd-43b2-9f0c-821cb961f734 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:40.755632 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9e440-24fd-43b2-9f0c-821cb961f734 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:40.761064 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12327c04-246f-42df-89ee-45e7221d308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:40.761662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12327c04-246f-42df-89ee-45e7221d308e admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.761940 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12327c04-246f-42df-89ee-45e7221d308e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.762210 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12327c04-246f-42df-89ee-45e7221d308e admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.762860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12327c04-246f-42df-89ee-45e7221d308e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:40.764483 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12327c04-246f-42df-89ee-45e7221d308e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:40.774668 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1281/2588] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:40.778805 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83897f1d-587e-49a7-b889-fffff86bd309 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:40.789659 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83897f1d-587e-49a7-b889-fffff86bd309 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:40.795494 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88478be1-72aa-408a-ad21-2907136408ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:40.796244 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478be1-72aa-408a-ad21-2907136408ff admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.796519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478be1-72aa-408a-ad21-2907136408ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.796782 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478be1-72aa-408a-ad21-2907136408ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.797419 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88478be1-72aa-408a-ad21-2907136408ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:40.799447 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88478be1-72aa-408a-ad21-2907136408ff admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:40.810390 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1308/2589] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:40.814761 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12327c04-246f-42df-89ee-45e7221d308e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:40.825135 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12327c04-246f-42df-89ee-45e7221d308e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:40.830270 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6519b8d-2e62-4cda-ac2a-ebc6ed08ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:40.830918 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6519b8d-2e62-4cda-ac2a-ebc6ed08ae4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.831242 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6519b8d-2e62-4cda-ac2a-ebc6ed08ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.831517 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6519b8d-2e62-4cda-ac2a-ebc6ed08ae4c admin admin] PATH_INFO: `/v3/projects/ff1c6a0775db487e964a2636ba97ce1d/users/0fe74f6b08d748629003d7b8ad62bcb7/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.847990 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6519b8d-2e62-4cda-ac2a-ebc6ed08ae4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1c6a0775db487e964a2636ba97ce1d, user_id=0fe74f6b08d748629003d7b8ad62bcb7, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:40.850645 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6519b8d-2e62-4cda-ac2a-ebc6ed08ae4c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:40.866171 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1282/2590] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:52:40 2022] PUT /identity/v3/projects/ff1c6a0775db487e964a2636ba97ce1d/users/0fe74f6b08d748629003d7b8ad62bcb7/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:40.878553 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac723-2e97-477e-9d5f-3c27a0765d56 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:40.878842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac723-2e97-477e-9d5f-3c27a0765d56 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:40.879143 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac723-2e97-477e-9d5f-3c27a0765d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:40.909231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e0aac723-2e97-477e-9d5f-3c27a0765d56 None None] MFA Rules not processed for user `0fe74f6b08d748629003d7b8ad62bcb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:40.910452 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e0aac723-2e97-477e-9d5f-3c27a0765d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:40.974260 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1309/2591] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:40.989102 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6519b8d-2e62-4cda-ac2a-ebc6ed08ae4c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:40.991318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b6519b8d-2e62-4cda-ac2a-ebc6ed08ae4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:41.014890 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:41.051555 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6519b8d-2e62-4cda-ac2a-ebc6ed08ae4c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:41.055720 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f04c-ed04-4813-86c1-8f40973a21f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:41.056323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f04c-ed04-4813-86c1-8f40973a21f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:41.056592 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f04c-ed04-4813-86c1-8f40973a21f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:41.056857 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f04c-ed04-4813-86c1-8f40973a21f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:41.065699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439f04c-ed04-4813-86c1-8f40973a21f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:41.067151 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439f04c-ed04-4813-86c1-8f40973a21f0 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:41.076182 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1283/2592] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:41.108278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac723-2e97-477e-9d5f-3c27a0765d56 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:41.129729 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:41.182349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac723-2e97-477e-9d5f-3c27a0765d56 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:41.188387 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:41.189183 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:41.189458 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:41.189722 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] PATH_INFO: `/v3/users/0fe74f6b08d748629003d7b8ad62bcb7` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:41.191040 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe74f6b08d748629003d7b8ad62bcb7)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:41.192982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:41.247894 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe74f6b08d748629003d7b8ad62bcb7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.248612 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe74f6b08d748629003d7b8ad62bcb7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.257484 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe74f6b08d748629003d7b8ad62bcb7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.272784 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe74f6b08d748629003d7b8ad62bcb7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.273567 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe74f6b08d748629003d7b8ad62bcb7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.289103 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1310/2593] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:41 2022] DELETE /identity/v3/users/0fe74f6b08d748629003d7b8ad62bcb7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:41.293689 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6968-d6ce-4d20-a6a0-8c8616cd6928 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:41.293977 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6968-d6ce-4d20-a6a0-8c8616cd6928 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:41.294287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6968-d6ce-4d20-a6a0-8c8616cd6928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:41.313505 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-566e6968-d6ce-4d20-a6a0-8c8616cd6928 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:41.314828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-566e6968-d6ce-4d20-a6a0-8c8616cd6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:41.375758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1284/2594] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:41.386302 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:41.387892 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:41.447118 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd0c39-a442-4017-9a82-9a7dcb884856 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:41.451556 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aee1bf-1d13-4afb-ab3c-d99bdf6bf8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:41.452156 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aee1bf-1d13-4afb-ab3c-d99bdf6bf8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:41.452418 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aee1bf-1d13-4afb-ab3c-d99bdf6bf8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:41.452692 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aee1bf-1d13-4afb-ab3c-d99bdf6bf8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:41.462294 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aee1bf-1d13-4afb-ab3c-d99bdf6bf8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:41.463745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aee1bf-1d13-4afb-ab3c-d99bdf6bf8f0 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:41.473318 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1311/2595] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:41.749222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6968-d6ce-4d20-a6a0-8c8616cd6928 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:41.750993 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-566e6968-d6ce-4d20-a6a0-8c8616cd6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:41.763858 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6968-d6ce-4d20-a6a0-8c8616cd6928 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:41.768916 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:41.769614 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:41.769968 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:41.770244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] PATH_INFO: `/v3/projects/ff1c6a0775db487e964a2636ba97ce1d` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:41.771427 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1c6a0775db487e964a2636ba97ce1d)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:41.773317 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:41.823856 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1c6a0775db487e964a2636ba97ce1d', 'request_id': 'req-76241b5e-5cc7-4bb3-a884-608ecec75f99'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.830261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1c6a0775db487e964a2636ba97ce1d', 'request_id': 'req-76241b5e-5cc7-4bb3-a884-608ecec75f99'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.836405 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1c6a0775db487e964a2636ba97ce1d', 'request_id': 'req-76241b5e-5cc7-4bb3-a884-608ecec75f99'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.850515 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] The token cache is being invalidate because project ff1c6a0775db487e964a2636ba97ce1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:41.851149 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.851554 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76241b5e-5cc7-4bb3-a884-608ecec75f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:41.853157 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1285/2596] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:41 2022] DELETE /identity/v3/projects/ff1c6a0775db487e964a2636ba97ce1d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:41.858236 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae3cc-64ae-4436-ad8b-a6ad6887c0aa None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:41.858716 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae3cc-64ae-4436-ad8b-a6ad6887c0aa None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:41.858835 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae3cc-64ae-4436-ad8b-a6ad6887c0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:41.880929 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f7eae3cc-64ae-4436-ad8b-a6ad6887c0aa None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:41.882110 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f7eae3cc-64ae-4436-ad8b-a6ad6887c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:41.917226 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:41.945283 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1312/2597] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:41.953124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860497d5-e3eb-4eb8-9cdf-b22d3a88f016 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:41.953411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860497d5-e3eb-4eb8-9cdf-b22d3a88f016 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:41.953682 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860497d5-e3eb-4eb8-9cdf-b22d3a88f016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:41.975208 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-860497d5-e3eb-4eb8-9cdf-b22d3a88f016 None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:41.976422 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-860497d5-e3eb-4eb8-9cdf-b22d3a88f016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:41.986016 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1286/2598] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:41.990588 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae3cc-64ae-4436-ad8b-a6ad6887c0aa None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:42.002402 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae3cc-64ae-4436-ad8b-a6ad6887c0aa None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:42.008045 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c033-8db4-402d-9f41-544e9ba619fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:42.008651 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c033-8db4-402d-9f41-544e9ba619fc admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:42.008928 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c033-8db4-402d-9f41-544e9ba619fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:42.009194 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c033-8db4-402d-9f41-544e9ba619fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:42.009859 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64c033-8db4-402d-9f41-544e9ba619fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:52:42.010153 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64c033-8db4-402d-9f41-544e9ba619fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:42.011793 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64c033-8db4-402d-9f41-544e9ba619fc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:42.023410 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1313/2599] 10.222.0.46 () {58 vars in 1153 bytes} [Mon Oct 24 13:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:52:42.027860 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860497d5-e3eb-4eb8-9cdf-b22d3a88f016 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:42.037271 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860497d5-e3eb-4eb8-9cdf-b22d3a88f016 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:42.042143 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c5a2c-2cdb-4a34-b11d-f8ee8ecea394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:42.042740 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c5a2c-2cdb-4a34-b11d-f8ee8ecea394 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:42.043055 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c5a2c-2cdb-4a34-b11d-f8ee8ecea394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:42.043323 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c5a2c-2cdb-4a34-b11d-f8ee8ecea394 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:42.043957 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c5a2c-2cdb-4a34-b11d-f8ee8ecea394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:42.045851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c5a2c-2cdb-4a34-b11d-f8ee8ecea394 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:42.076662 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1287/2600] 10.222.0.46 () {60 vars in 1153 bytes} [Mon Oct 24 13:52:42 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:52:42.081595 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c033-8db4-402d-9f41-544e9ba619fc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:42.091813 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c033-8db4-402d-9f41-544e9ba619fc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:42.152991 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804a3bd-c8e4-4a9f-8e1a-9c250a534442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:42.153601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a3bd-c8e4-4a9f-8e1a-9c250a534442 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:42.153911 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a3bd-c8e4-4a9f-8e1a-9c250a534442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:42.154304 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a3bd-c8e4-4a9f-8e1a-9c250a534442 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:42.155296 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804a3bd-c8e4-4a9f-8e1a-9c250a534442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:42.158192 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804a3bd-c8e4-4a9f-8e1a-9c250a534442 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:42.187945 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1314/2601] 10.222.0.46 () {60 vars in 1144 bytes} [Mon Oct 24 13:52:42 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:52:42.193413 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c5a2c-2cdb-4a34-b11d-f8ee8ecea394 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:42.204530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c5a2c-2cdb-4a34-b11d-f8ee8ecea394 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:42.209539 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0fe2b-623c-4c85-9cac-8724bbf9ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:42.210159 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fe2b-623c-4c85-9cac-8724bbf9ace7 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:42.210437 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fe2b-623c-4c85-9cac-8724bbf9ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:42.210708 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fe2b-623c-4c85-9cac-8724bbf9ace7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:42.211382 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0fe2b-623c-4c85-9cac-8724bbf9ace7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:42.212976 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0fe2b-623c-4c85-9cac-8724bbf9ace7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:42.223780 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1288/2602] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:42.227796 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804a3bd-c8e4-4a9f-8e1a-9c250a534442 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:42.238088 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804a3bd-c8e4-4a9f-8e1a-9c250a534442 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:42.244065 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae1c1-7829-4693-bf64-aebcb192b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:42.244654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae1c1-7829-4693-bf64-aebcb192b691 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:42.244922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae1c1-7829-4693-bf64-aebcb192b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:42.245190 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae1c1-7829-4693-bf64-aebcb192b691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:42.245809 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae1c1-7829-4693-bf64-aebcb192b691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:42.247426 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae1c1-7829-4693-bf64-aebcb192b691 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:42.258864 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1315/2603] 10.222.0.46 () {58 vars in 1122 bytes} [Mon Oct 24 13:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:52:42.263045 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0fe2b-623c-4c85-9cac-8724bbf9ace7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:42.273967 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0fe2b-623c-4c85-9cac-8724bbf9ace7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:42.279831 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac148eb-1465-4f6d-905c-4662f0c7d37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:42.281240 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac148eb-1465-4f6d-905c-4662f0c7d37f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:42.281953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac148eb-1465-4f6d-905c-4662f0c7d37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:42.281953 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac148eb-1465-4f6d-905c-4662f0c7d37f admin admin] PATH_INFO: `/v3/projects/c23ff14ca59d4d36a2288d87ea140a33/users/706e3e2c5e6c4788aa7c5e48da6c9ffc/roles/28346cbeb7e94e25b52f586669c5beaa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:42.284530 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:42.301109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac148eb-1465-4f6d-905c-4662f0c7d37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23ff14ca59d4d36a2288d87ea140a33, user_id=706e3e2c5e6c4788aa7c5e48da6c9ffc, role_id=28346cbeb7e94e25b52f586669c5beaa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:42.303898 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac148eb-1465-4f6d-905c-4662f0c7d37f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:42.320815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1289/2604] 10.222.0.46 () {60 vars in 1483 bytes} [Mon Oct 24 13:52:42 2022] PUT /identity/v3/projects/c23ff14ca59d4d36a2288d87ea140a33/users/706e3e2c5e6c4788aa7c5e48da6c9ffc/roles/28346cbeb7e94e25b52f586669c5beaa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:42.331465 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e383a4c-163d-49c6-abbe-756615988360 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:42.331748 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e383a4c-163d-49c6-abbe-756615988360 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:42.332053 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e383a4c-163d-49c6-abbe-756615988360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:42.360395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4e383a4c-163d-49c6-abbe-756615988360 None None] MFA Rules not processed for user `706e3e2c5e6c4788aa7c5e48da6c9ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:42.361606 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4e383a4c-163d-49c6-abbe-756615988360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:42.429170 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1316/2605] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:52:42.440421 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac148eb-1465-4f6d-905c-4662f0c7d37f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:42.442436 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0ac148eb-1465-4f6d-905c-4662f0c7d37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:42.500077 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac148eb-1465-4f6d-905c-4662f0c7d37f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:42.504375 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeacfd7-8532-4303-9fc9-fdf47f53e18e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c812964d514d3f8082f90d0f512246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:42.504963 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacfd7-8532-4303-9fc9-fdf47f53e18e service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:42.505237 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacfd7-8532-4303-9fc9-fdf47f53e18e service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:42.505568 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacfd7-8532-4303-9fc9-fdf47f53e18e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:42.514279 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeacfd7-8532-4303-9fc9-fdf47f53e18e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:42.515691 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeacfd7-8532-4303-9fc9-fdf47f53e18e service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:42.524681 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1290/2606] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:50.590547 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e383a4c-163d-49c6-abbe-756615988360 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:50.592365 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4e383a4c-163d-49c6-abbe-756615988360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:50.639855 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:50.668171 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e383a4c-163d-49c6-abbe-756615988360 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:50.672908 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:50.673542 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:50.673818 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:50.674090 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] PATH_INFO: `/v3/users/5d2746d98a1a47fab7a03ffe3396231f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:50.675248 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2746d98a1a47fab7a03ffe3396231f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:50.677166 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:50.734223 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2746d98a1a47fab7a03ffe3396231f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:50.734880 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2746d98a1a47fab7a03ffe3396231f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:50.742654 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2746d98a1a47fab7a03ffe3396231f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:50.761745 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2746d98a1a47fab7a03ffe3396231f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:50.762434 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2746d98a1a47fab7a03ffe3396231f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:50.777762 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1317/2607] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:50 2022] DELETE /identity/v3/users/5d2746d98a1a47fab7a03ffe3396231f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:50.782462 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f947fa2-be26-4aed-8466-4dbdbb8853df None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:50.783003 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f947fa2-be26-4aed-8466-4dbdbb8853df None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:50.783124 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f947fa2-be26-4aed-8466-4dbdbb8853df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:50.802324 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5f947fa2-be26-4aed-8466-4dbdbb8853df None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:50.803699 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5f947fa2-be26-4aed-8466-4dbdbb8853df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:50.866166 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1291/2608] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:52:50.877335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:50.879261 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:50.939663 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e442b4-5b2f-4013-b7b2-b22b0dcc5b5b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:50.943681 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51576a6-4bc4-4080-a47a-4fbb5e50f589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:50.944281 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51576a6-4bc4-4080-a47a-4fbb5e50f589 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:50.944566 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51576a6-4bc4-4080-a47a-4fbb5e50f589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:50.944829 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51576a6-4bc4-4080-a47a-4fbb5e50f589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:50.954831 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51576a6-4bc4-4080-a47a-4fbb5e50f589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:50.956316 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51576a6-4bc4-4080-a47a-4fbb5e50f589 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:50.966435 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1318/2609] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:52:51.257104 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f947fa2-be26-4aed-8466-4dbdbb8853df None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:51.258781 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5f947fa2-be26-4aed-8466-4dbdbb8853df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:51.272107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f947fa2-be26-4aed-8466-4dbdbb8853df None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:51.277783 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:51.278426 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:51.278787 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:51.278985 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] PATH_INFO: `/v3/projects/f931c16c358b4f6db4383b8fbd67fb7a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:51.280201 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f931c16c358b4f6db4383b8fbd67fb7a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:51.282122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:51.333713 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f931c16c358b4f6db4383b8fbd67fb7a', 'request_id': 'req-d39a6d87-eecd-43bc-96be-0ab42d3648fc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:51.339915 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f931c16c358b4f6db4383b8fbd67fb7a', 'request_id': 'req-d39a6d87-eecd-43bc-96be-0ab42d3648fc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:51.345753 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f931c16c358b4f6db4383b8fbd67fb7a', 'request_id': 'req-d39a6d87-eecd-43bc-96be-0ab42d3648fc'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:51.360907 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] The token cache is being invalidate because project f931c16c358b4f6db4383b8fbd67fb7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:51.361192 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:51.361799 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d39a6d87-eecd-43bc-96be-0ab42d3648fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:51.363352 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1292/2610] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:51 2022] DELETE /identity/v3/projects/f931c16c358b4f6db4383b8fbd67fb7a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:52.941968 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51576a6-4bc4-4080-a47a-4fbb5e50f589 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:52.944460 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d51576a6-4bc4-4080-a47a-4fbb5e50f589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:52.964032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51576a6-4bc4-4080-a47a-4fbb5e50f589 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:53.023572 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:53.030774 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:53.031425 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:53.031704 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:53.031982 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] PATH_INFO: `/v3/users/706e3e2c5e6c4788aa7c5e48da6c9ffc` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:53.033395 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=706e3e2c5e6c4788aa7c5e48da6c9ffc)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:53.035665 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:53.086619 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '706e3e2c5e6c4788aa7c5e48da6c9ffc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.087315 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '706e3e2c5e6c4788aa7c5e48da6c9ffc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.094246 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '706e3e2c5e6c4788aa7c5e48da6c9ffc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.106599 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '706e3e2c5e6c4788aa7c5e48da6c9ffc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.107215 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '706e3e2c5e6c4788aa7c5e48da6c9ffc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.121601 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1319/2611] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:52:52 2022] DELETE /identity/v3/users/706e3e2c5e6c4788aa7c5e48da6c9ffc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:52:53.126168 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0d7d-cf18-4965-ace5-7daf0cd0b9dd None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:53.126651 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0d7d-cf18-4965-ace5-7daf0cd0b9dd None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:53.126766 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0d7d-cf18-4965-ace5-7daf0cd0b9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:53.147031 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5deb0d7d-cf18-4965-ace5-7daf0cd0b9dd None None] MFA Rules not processed for user `5707d799f4af482d868dd62b5ec82b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:52:53.148222 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5deb0d7d-cf18-4965-ace5-7daf0cd0b9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:53.154287 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:53.218710 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1293/2612] 10.222.0.46 () {58 vars in 958 bytes} [Mon Oct 24 13:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:52:53.228892 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:53.230476 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:53.299518 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863db54-8051-4349-bd31-eeafb97f0b3b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:53.305251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941deab9-98b9-49c2-8021-3f83118ede3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:53.306278 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941deab9-98b9-49c2-8021-3f83118ede3b service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:53.306750 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941deab9-98b9-49c2-8021-3f83118ede3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:53.307142 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941deab9-98b9-49c2-8021-3f83118ede3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:53.317503 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941deab9-98b9-49c2-8021-3f83118ede3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:53.319047 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941deab9-98b9-49c2-8021-3f83118ede3b service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:53.329242 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1320/2613] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:52:53.612658 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb0d7d-cf18-4965-ace5-7daf0cd0b9dd None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:52:53.614127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5deb0d7d-cf18-4965-ace5-7daf0cd0b9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:52:53.628955 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb0d7d-cf18-4965-ace5-7daf0cd0b9dd None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:52:53.634874 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:52:53.635485 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:52:53.635757 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:52:53.636020 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] PATH_INFO: `/v3/projects/c23ff14ca59d4d36a2288d87ea140a33` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:52:53.637983 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23ff14ca59d4d36a2288d87ea140a33)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:52:53.640261 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:52:53.700248 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23ff14ca59d4d36a2288d87ea140a33', 'request_id': 'req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.706531 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23ff14ca59d4d36a2288d87ea140a33', 'request_id': 'req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.718974 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23ff14ca59d4d36a2288d87ea140a33', 'request_id': 'req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.736828 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] The token cache is being invalidate because project c23ff14ca59d4d36a2288d87ea140a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:52:53.737097 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.737838 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:52:53.739411 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1294/2614] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:52:53 2022] DELETE /identity/v3/projects/c23ff14ca59d4d36a2288d87ea140a33 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:53:03.324922 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:53:03.733723 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:53:24.966662 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941deab9-98b9-49c2-8021-3f83118ede3b service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:53:24.977220 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941deab9-98b9-49c2-8021-3f83118ede3b service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:53:25.030584 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:53:25.031208 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:53:25.031475 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:53:25.031737 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:53:25.033691 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:53:25.043173 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:53:25.044588 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:53:25.052588 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1321/2615] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:53:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:53:35.049231 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=26 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:31.437769 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:54:31.440080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:54:31.459386 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a2bb3-6fc6-4741-a664-fe7a2edd41c9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:54:31.463914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:54:31.464513 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:54:31.464789 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:54:31.465056 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:54:31.467101 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:54:31.553015 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:54:31.554455 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:54:31.565642 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1295/2616] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:54:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:54:32.766483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:54:32.768060 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:54:32.779068 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5790ac-ccf5-446c-8a96-2b685a8692a3 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:54:32.783506 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:54:32.784097 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:54:32.784369 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:54:32.784626 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:54:32.786482 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:54:32.800341 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:54:32.801852 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:54:32.813827 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1322/2617] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:54:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:54:41.560897 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=34 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:42.808207 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:45.248679 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:54:45.250113 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:54:45.337018 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38201674-811e-4d7b-b273-acbd1cbd503b service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:54:45.343667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092a4e0-c365-4384-a736-cfad35b8f441 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:54:45.344370 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092a4e0-c365-4384-a736-cfad35b8f441 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:54:45.344650 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092a4e0-c365-4384-a736-cfad35b8f441 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:54:45.344914 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092a4e0-c365-4384-a736-cfad35b8f441 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:54:45.346824 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6092a4e0-c365-4384-a736-cfad35b8f441 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:54:45.360223 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092a4e0-c365-4384-a736-cfad35b8f441 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:54:45.361851 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092a4e0-c365-4384-a736-cfad35b8f441 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:54:45.373616 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1296/2618] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:54:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:54:47.554856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:54:47.556609 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:54:47.572245 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ebc5-93c3-47ac-8b61-bd2fbab1b773 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:54:47.579349 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def191c-7726-4d6e-b10c-7d274173b2ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:54:47.579978 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def191c-7726-4d6e-b10c-7d274173b2ca service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:54:47.580252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def191c-7726-4d6e-b10c-7d274173b2ca service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:54:47.580519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def191c-7726-4d6e-b10c-7d274173b2ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:54:47.582621 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9def191c-7726-4d6e-b10c-7d274173b2ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:54:47.596270 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def191c-7726-4d6e-b10c-7d274173b2ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:54:47.598453 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def191c-7726-4d6e-b10c-7d274173b2ca service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:54:47.636570 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1323/2619] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:54:55.368275 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=32 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:57.631652 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:55:24.643371 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092a4e0-c365-4384-a736-cfad35b8f441 service placement] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:55:24.654888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092a4e0-c365-4384-a736-cfad35b8f441 service placement] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:55:24.661194 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2355e-1612-4218-a004-9cc50945e0b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:55:24.661791 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2355e-1612-4218-a004-9cc50945e0b8 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:55:24.662060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2355e-1612-4218-a004-9cc50945e0b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:55:24.662325 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2355e-1612-4218-a004-9cc50945e0b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:55:24.664274 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-49e2355e-1612-4218-a004-9cc50945e0b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:55:24.675927 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2355e-1612-4218-a004-9cc50945e0b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:55:24.677581 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2355e-1612-4218-a004-9cc50945e0b8 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:55:24.688129 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1297/2620] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:55:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:55:34.683566 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:56:34.517359 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def191c-7726-4d6e-b10c-7d274173b2ca service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:34.530020 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def191c-7726-4d6e-b10c-7d274173b2ca service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:34.535733 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298fef8-27cd-489b-a556-cffe7fabf442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:34.536462 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298fef8-27cd-489b-a556-cffe7fabf442 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:34.536799 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298fef8-27cd-489b-a556-cffe7fabf442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:34.537135 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298fef8-27cd-489b-a556-cffe7fabf442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:34.539754 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0298fef8-27cd-489b-a556-cffe7fabf442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:34.600299 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298fef8-27cd-489b-a556-cffe7fabf442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:34.602032 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298fef8-27cd-489b-a556-cffe7fabf442 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:34.611627 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1324/2621] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:56:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:56:35.497935 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2355e-1612-4218-a004-9cc50945e0b8 service placement] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:35.514758 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2355e-1612-4218-a004-9cc50945e0b8 service placement] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:35.520656 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72003f1-2735-4915-bb61-050aa9f85916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:35.521448 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72003f1-2735-4915-bb61-050aa9f85916 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:35.521738 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72003f1-2735-4915-bb61-050aa9f85916 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:35.522007 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72003f1-2735-4915-bb61-050aa9f85916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:35.523875 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d72003f1-2735-4915-bb61-050aa9f85916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:35.536937 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72003f1-2735-4915-bb61-050aa9f85916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:35.539080 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72003f1-2735-4915-bb61-050aa9f85916 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:35.550346 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1298/2622] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:56:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:56:37.615899 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298fef8-27cd-489b-a556-cffe7fabf442 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:37.630123 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298fef8-27cd-489b-a556-cffe7fabf442 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:37.636806 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f5b069b5307470e96176481702d6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:37.637568 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:37.637815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:37.638073 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:37.640005 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:37.653154 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:37.654916 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:37.665856 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1325/2623] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:56:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:56:39.451739 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72003f1-2735-4915-bb61-050aa9f85916 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:39.461778 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72003f1-2735-4915-bb61-050aa9f85916 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:39.465318 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7609a-5de5-434f-b6ec-0452dd4822b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe801da792944be2b6342c483bcb88b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:39.465923 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7609a-5de5-434f-b6ec-0452dd4822b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:39.466200 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7609a-5de5-434f-b6ec-0452dd4822b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:39.466503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7609a-5de5-434f-b6ec-0452dd4822b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:39.468315 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e8d7609a-5de5-434f-b6ec-0452dd4822b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:39.533107 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7609a-5de5-434f-b6ec-0452dd4822b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:39.534540 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7609a-5de5-434f-b6ec-0452dd4822b0 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:39.544603 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1299/2624] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:56:42.694071 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:42.695802 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:42.710545 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63b123-7169-456b-80a5-72b4056d3d86 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:42.718538 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:42.719182 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:42.719480 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:42.719746 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:42.721687 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:42.734216 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:42.736167 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:42.748364 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1326/2625] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:56:45.620814 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7609a-5de5-434f-b6ec-0452dd4822b0 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:45.636239 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7609a-5de5-434f-b6ec-0452dd4822b0 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:45.643407 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dca2a-42f8-40a2-b5e5-6d9ebaa9f78c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:45.644127 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dca2a-42f8-40a2-b5e5-6d9ebaa9f78c service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:45.644859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dca2a-42f8-40a2-b5e5-6d9ebaa9f78c service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:45.644859 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dca2a-42f8-40a2-b5e5-6d9ebaa9f78c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:45.646704 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3e2dca2a-42f8-40a2-b5e5-6d9ebaa9f78c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:45.662060 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dca2a-42f8-40a2-b5e5-6d9ebaa9f78c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:45.665931 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dca2a-42f8-40a2-b5e5-6d9ebaa9f78c service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:45.680565 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1300/2626] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 13:56:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:56:45.682571 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:45.684057 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:45.701000 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a407aac-79f3-4cd0-b357-e6ed9d49fe4a service placement] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:45.705715 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:45.706340 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:45.706615 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:45.706879 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] PATH_INFO: `/v3/users/6b81558d71f84856b9fb079f88158896` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:45.709389 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b81558d71f84856b9fb079f88158896)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:45.711045 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:45.764717 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b81558d71f84856b9fb079f88158896'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:45.765900 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b81558d71f84856b9fb079f88158896'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:45.773680 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b81558d71f84856b9fb079f88158896'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:45.786247 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b81558d71f84856b9fb079f88158896'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:45.787326 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b81558d71f84856b9fb079f88158896'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:45.803196 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1327/2627] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:56:45 2022] DELETE /identity/v3/users/6b81558d71f84856b9fb079f88158896 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:56:45.992348 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dca2a-42f8-40a2-b5e5-6d9ebaa9f78c service placement] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:46.003815 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dca2a-42f8-40a2-b5e5-6d9ebaa9f78c service placement] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:46.063667 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:46.064305 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:46.064574 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:46.064840 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] PATH_INFO: `/v3/projects/e89bbf606b0840a6bd669a895a846675` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:46.066109 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89bbf606b0840a6bd669a895a846675)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:46.068053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:46.116888 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89bbf606b0840a6bd669a895a846675', 'request_id': 'req-8231ce61-7e54-4fce-908b-f78b6dbb929d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.123580 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89bbf606b0840a6bd669a895a846675', 'request_id': 'req-8231ce61-7e54-4fce-908b-f78b6dbb929d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.130195 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89bbf606b0840a6bd669a895a846675', 'request_id': 'req-8231ce61-7e54-4fce-908b-f78b6dbb929d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.141503 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:56:46.146944 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] The token cache is being invalidate because project e89bbf606b0840a6bd669a895a846675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:56:46.147480 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.148286 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.150254 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1301/2628] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:56:45 2022] DELETE /identity/v3/projects/e89bbf606b0840a6bd669a895a846675 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:56:46.154876 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:46.156842 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:46.176965 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a7f9a-acb1-4f21-bb67-728d2c2b4b2b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:46.221537 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:56:46.240124 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:46.240780 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:46.241058 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:46.241335 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] PATH_INFO: `/v3/users/e3d362aaddea45fb9cdcaba696a3001d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:46.242516 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d362aaddea45fb9cdcaba696a3001d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:46.244620 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:46.309252 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d362aaddea45fb9cdcaba696a3001d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.310102 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d362aaddea45fb9cdcaba696a3001d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.322251 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d362aaddea45fb9cdcaba696a3001d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.337602 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d362aaddea45fb9cdcaba696a3001d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.338483 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d362aaddea45fb9cdcaba696a3001d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.359519 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1328/2629] 10.222.0.46 () {58 vars in 1224 bytes} [Mon Oct 24 13:56:46 2022] DELETE /identity/v3/users/e3d362aaddea45fb9cdcaba696a3001d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:56:46.574843 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:56:46.576578 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:56:46.596005 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231ce61-7e54-4fce-908b-f78b6dbb929d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:56:46.661826 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5707d799f4af482d868dd62b5ec82b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2412fb672dec485f9e4dda53e202b718', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:56:46.662612 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:56:46.662715 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:56:46.663122 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] PATH_INFO: `/v3/projects/b971a2742a7e4b19ade38208747967bf` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:56:46.664117 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b971a2742a7e4b19ade38208747967bf)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:56:46.666053 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:56:46.729811 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b971a2742a7e4b19ade38208747967bf', 'request_id': 'req-f9dcf46b-88d2-4144-97eb-bc386f4a2927'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.737399 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b971a2742a7e4b19ade38208747967bf', 'request_id': 'req-f9dcf46b-88d2-4144-97eb-bc386f4a2927'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.744727 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b971a2742a7e4b19ade38208747967bf', 'request_id': 'req-f9dcf46b-88d2-4144-97eb-bc386f4a2927'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.764705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] The token cache is being invalidate because project b971a2742a7e4b19ade38208747967bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:56:46.764705 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.765089 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f9dcf46b-88d2-4144-97eb-bc386f4a2927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:56:46.767244 dv-cinder-862490-2-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1302/2630] 10.222.0.46 () {58 vars in 1233 bytes} [Mon Oct 24 13:56:46 2022] DELETE /identity/v3/projects/b971a2742a7e4b19ade38208747967bf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:56:56.355815 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:56:56.758889 dv-cinder-862490-2-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 14:00:28.642145 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 14:00:28.643825 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 14:00:28.790499 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fbc91-6a03-487f-a1fe-ed1a0dd52350 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 14:00:28.854541 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7ba57-ce60-4035-bbce-cd831b3bcec7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f040c31c0d4439594404739d44a5435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11342796e85b428195cf5155b512162c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 14:00:28.855204 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ba57-ce60-4035-bbce-cd831b3bcec7 service placement] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 14:00:28.855478 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ba57-ce60-4035-bbce-cd831b3bcec7 service placement] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 14:00:28.855742 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ba57-ce60-4035-bbce-cd831b3bcec7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 14:00:28.857835 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-19d7ba57-ce60-4035-bbce-cd831b3bcec7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 14:00:28.870079 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7ba57-ce60-4035-bbce-cd831b3bcec7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 14:00:28.871710 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7ba57-ce60-4035-bbce-cd831b3bcec7 service placement] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 14:00:28.882618 dv-cinder-862490-2-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1329/2631] 10.222.0.46 () {60 vars in 1365 bytes} [Mon Oct 24 14:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 14:00:38.878301 dv-cinder-862490-2-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}